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[57] ABSTRACT 

An apparatus and method for a user to program a personal 
software agent using an agent manager. The agent manager 
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a hierarchical order. A determination is made as to whether 
the rule is valid within the hierarchical order. If the rule is 
not valid, repairs are suggested to make the rule valid. 
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APPARATUS AND METHOD FOR DEFINING The fundamental ontology, or vocabulary, usually consists 

RULES FOR PERSONAL AGENTS of objects and actions. In messaging, for example, objects 

includes messages, folders, persons and groups. Actions in 

CROSS-REFERENCES TO RELATED messaging include moving a message to a folder, forwarding 

APPLICATIONS 5 the message to another user, and replying to the sender. 

Some objects and actions are very general and thus useful in 

This application claims the benefit of U.S. provisional many domains, e.g., notification actions such as popping up 

application Ser. No. 60/015,070, filed Apr. 9, 1996, entitled a window on a computer screen, placing a call, and paging. 

"Apparatus and Methods for Defining Rules" The agent also requires knowledge about it's owners 

PAP^DmiMn ™ -rue TKn/T:MT7nw io P references > habits ™ d EPals, which is typically supplied by 

BACKGROUND OF THE INVENTION mc ^ Much of mis type of j^^ge can ^ expr essed 

The invention relates to an agent manager for personal as tf-Then rules. Examples of such rules might include: 

software agents. More particularly, the invention relates to a 1- (messaging) If I get a message from by boss with the 

method and apparatus for defining rules for personal agents subject "urgent" after business hours, then notify me by 

to acquire user-specific knowledge and accomplish user 15 calling my home number. 

specified tasks. 2. (banking) If the balance in my checking account falls 
Personal software agents are computer programs that act below $500 and the balance in my savings account is 
on behalf of users to perform routine, tedious and time- f bove $2000, then transfer $500 from savings to check- 
consuming tasks. To be useful to an individual user, an agent m S- 

must be personalized to the individual user's goals, habits 20 3. (finances) If the price of XYZ stock falls below $30, 

and preferences. Thus, there exists a substantial need for the buy 100 shares. 

agent to efficiently and effectively acquire user-specific The effective acquisition of user-specific knowledge has 

knowledge from the user. Previous attempts to solve this posed a serious problem in the area of personal software 

problem, however, prove to be unsatisfactory in many ways. agents. Conventional methods for a software agent ma nag- 

The concept of agency, or the use of agents, is well 25 ers t0 user-specific knowledge fall within three 
established. An agent is a person authorized by another broad categories: (1) learning; (2) programming by demon- 
person, typically referred to as a principal, to act on behalf stration < PBD )« and ( 3 ) end-user programming (EUP). Each 
of the principal. In this manner, the principal empowers the of thcse categories of methods will be discussed in turn, 
agent to perform any of the tasks that the principal is ^ learning approach is detailed in a paper by P. Maes 
unwilling or unable to perform. For example, an insurance 30 litled "Agents that Reduce Work and Information 
agent may handle all insurance matters for a principal, a Overload," CACM 37, 7 (July 1994), pp. 55-67. The agent 
talent agent may act on behalf of a performer in arranging learns ^ s bv watchin g user behavior and detecting pat- 
concert dates, and a foreign agent may spy on other gov- terns and regularities. The agent records a user's activity in 
ernments to gather secret information on behalf of his or her lerms of situation-action pairs. For example, a situation 
government 35 cou ^ ^ e an e-mail message and an action the way the user 

nr., j t n . j ■ r processed the message. The system predicts how a new 

With the advent of the computer, a new domain for , . , , ~ „ . . J - ,. r iL , . ., 

1 • t , j «■ . j . * situation should be handled by finding the most similar 

employing agents has opened up. Significant advances in the . . . a a- u 1 .1. 

1 f ,? c • 1 • ^ u • K 1 * . , previously seen situation. After seemg enough examples, the 

realm 01 artificial intelligence have enabled computer pro- . . ' . , . ,. x . °, , 

u u it e * * 5 system is able to make good predictions, and make sueges- 

grams to act on behalf of computer users to perform routine, 4Q ^ m ^ J* * ^ 

tedious and other time-consuming tasks. These computer Qn Qwn when * e * 

programs are referred to as 'software agents. predictions exceeds a specified threshold. 

Moreover, there has been a recent proliferation of com- ^ bfem with ^ leamin method is mal the , 

puter and communications networks. These networks permit manager has a sJow lean]i curye ^ m f is 

a user to access vast amounts of information and services 45 UDable to oflfer any advice until has seen a si ificant 

without essentially, any geographical boundaries. Thus a DUmber of exa les . Further) tne m ma cannot 

personal software agent has a ric h environment to perform offer ^ tru]y new filiations since there were no 

a large number of tasks on behalf of a user. For example, it previous examples from which to draw. This limitation can 

is now possible for a software agent to make an airline be by one Mftwflre agenl manager to 

reservation, purchase the ticket, and have the ticket deliv- 50 access the exp erience of another software agent manager, 

ered directly to a user. Similarly, a software agent could scan ^ solutionj however, fails to personalize the agent in the 

the Internet and World Wide Web (WWW) to retrieve pre fe re nces, habits and goals of the agent's owner, 

information ranging from the latest sports or news to a ^ PBD method is discussed in a book by A Cypher 

particular graduate thesis m molecular biology. A scenario m&d « Watch What l Do . p rogrammmg by Demonstration," 

could even be envisioned where a personal software agent 55 MITPresS) Cambridge, Mass., 1993. In PBD, a user puts a 

automatically checks the weather every morning and system inlQ record mode to record 

a user's actions in an 

changes a users wake-up alarm accordingly, e.g., one-hour executable file. This technique is similar to the macro 

later in the case of a snow delay. tiaaxitxm on many popular word processors. The prototypical 

To operate effectively, software agents require agent man- PBD systems operate in domains that have a natural graphi- 

agers to acquire certain information. This information can be 60 ca [ representation. One example is KIDSIM which is out- 

generally categorized as: (1) knowledge of the task domains Kned in a paper by D.C. Smith et al. titled "KIDSIM: 

within which the agent is to work; and (2) user-specific Programming Agents Without a Programming Language," 

knowledge such as a user's preferences, habits and goals. CACM 37, 7 (July 1994), 55-67. In KIDSIM, children create 

Knowledge of the task domains within which an agent is simulations in which characters move around in a two- 

to operate is usually supplied by the application developer. 65 dimensional world. They create rules by using a graphical 

Examples of various task domains include electronic editor to depict changes of state — that is, they draw the 

messaging, electronic banking or personal financial services. configuration of the world before and after the rule has 
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applied. The system generalizes from the concrete objects in of the invention may be more clearly understood by refer- 

the demonstration to create an abstract rule, e.g., replacing ence to the following detailed description of the invention, 

a particular character by any character of a certain type and the appended claims and to the several drawings attached 

replacing absolute locations by relative changes in location. herein. 

The problem with the personal agents using the PBD 5 

method is that there is no mechanism by which the personal BRIEF DESCRIPTION OF THE DRAWINGS 

agent may determine if rules are incompatible with other „ T ~ . . a ,. .„ . n . 

, w .j, , . i FIG. 1 is a now diagram illustrating the overall structure 

rules. Moreover, if there are incompatibilities, the personal - , . F\, . . ° 

, , , „ , r r .l • 1-j i of one embodiment of the invention, 
agent does not oner solutions for repairing the invalid rule. 

The foundational research on end-user programming 10 FIG - 2 * a flow diagram of a decision -making portion of 

(EUP) is found in a work by T. W. Malone et al. titled a rale ^ module used m accordance with one embodiment 

"Experiments with Oval: A radically Tailorable Tool for of me invention. 

Cooperative Work," A CM Transactions on Information Sys- FIG. 3 is a picture of a rule editor used in accordance with 

terns 13, 2 (April 1995), 177-205. A user first indicates the one embodiment of the invention. 

type of object to which the rule applies, such as a message. 15 FIG. 4 is a flow diagram of a new rule portion of a rule 

The user then describes the conditions of the rule by filling edit module used in accordance with one embodiment of the 

out a form that contains a field for each attribute of the invention. 

object. For messages, the attributes would include sender, FIG. 5 is a flow diagram of an existing rule portion of a 

subject, recipient, and so forth. Finally, the user specifies the mle edit modu i e use d in accordance with one embodiment 

actions of the rule by selecting from a list of all the actions 20 G f me invention. 

that could apply to this type of object. For example, a , . „ , ... . • 

i j i_ ' j ■ j r j j j i j j FIG. 6 is a now diagram of a rule index module used in 

message could be moved, copied, forwarded, deleted, and so , °, ,. , . t , . 

& r accordance with one embodiment of the invention. 

on. 

As with personal agents using the PBD method, tradi- Fia 7 is a flow diagram of a rule analysis module used 

tional personal agents using the EUP method are incapable 25 in accordance with one embodiment of the invention, 

of determining whether rules are incompatible with other FIG. 8 is a flow diagram of a first portion of a rule repair 

rules, and if so, offering repairs to the rule. module used in accordance with one embodiment of the 

A substantial need, therefore, exists for an agent manager invention, 

which can acquire user-specific knowledge in the form of FIG. 9 is a flow diagram of a second portion of a rule 

rules in a manner which is timely and precise, and which can 30 repair module used in accordance with one embodiment of 

detect and repair any conflicts with existing rules. the invention. 

SUMMARY OF THE INVENTION DETAILED DESCRIPTION 

In view of the foregoing, there exists a need in the art for Referring now in detail to the drawings wherein like parts 

a method and apparatus for solving the above-stated prob- are designated by like reference numerals throughout, there 

lems. More particularly, there is a need in the art for a is illustrated in FIG. 1 a flow diagram illustrating the overall 

method and apparatus for a personal software agent using structure of one embodiment of the invention. FIG. 1 shows 

enhanced EUP methods to acquire knowledge about a user's four modules: rule edit module 200; rule index module 300; 

habits, preferences and goals using an agent manager. The rule analysis module 400; and rule repair module 500. 

agent manager allows the user to define new rules, and 40 invention relates to an agent manager for personal 

determines whether such rules conflict with existing rules. If software agents. More particularly, the invention relates to a 

such a conflict exists, the agent manager interactively guides method and apparatus for defining rules for personal agents 

the user in selecting and applying repairs for the new rules to acquire user-specific knowledge and accomplish user 

to remove the conflict. 45 spec ined tasks. 

Thus, one embodiment of the invention permits a user and 7 D e invention comprises an agent manager which 

agent manager to collaborate in developing and managing a improves end-user programming by allowing the agent 

set of rules that embody the user's preferences for handling manager to perform the more complicated programming 

a wide variety of situations. tasks for the user, thereby minimizing programming com- 

This is accomplished using an apparatus and method for 50 mands and syntax for the user. The agent manager allows the 

defining rules for a personal software agent. One embodi- user to focus on three tasks: (1) define conditions; (2) define 

ment of the invention includes an agent manager which uses attributes; and (3) define actions. Once these three tasks are 

a rule edit module for defining at least one condition and at accomplished, a rule is formed. As a user creates or edits 

least one action to form a new rule. The invention uses a rule rules, the agent manager analyzes the rules for problems, 

index module for placing the new rule in a rule hierarchy, 55 computes methods of repairing the problems, and guides the 

wherein the hierarchy is comprised of parent rules, child user in selecting and applying the repairs, 

rules, and sibling rules. The rule index module adds actions The agent manager's role is to watch for problems as 

from the parent rules to the new rule and from the new rule US ers create or edit rules and help users to repair problems 

to the child rules. The rule index module also creates that it detects. Specifically, the agent manager detects when 

intersection rules from an intersection of the new rule with go a rule's plan is not valid, i.e., some action does not apply or 

the sibling rules. The invention uses a rule analysis module the rule conflicts with an existing rule. This can occur either 

for determining whether the new rule and the intersection as a user edits a rule or when a new rule is added to a rule 

rules conflict with any existing rules in the hierarchy. The hierarchy (due to interactions with other rules, described 

invention uses a rule repair module for repairing the new and m ore fully below). When the agent manager finds an invalid 

intersection rules where such conflicts exist. ^5 plan, it computes repairs, which are changes to the plan that 

With these and other advantages and features of the will make the plan valid. It then presents an interactive 

invention that will become hereinafter apparent, the nature explanation that explains the nature of the problem and 
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guides the user in selecting a repair. One embodiment of 
invention will be discussed in detail using electronic mail as 
an example. 

FIG. 2 is a flow diagram of a portion of a rule edit module 
used in accordance with an embodiment of the invention. 
The invention uses rule edit module 200 to specify rule 
conditions and actions. As shown in FIG. 2, if a user wants 
to enter a new rule at step 202, the rule edit module performs 
the actions detailed in FIG. 4. If a user wants to edit an 
existing rule at step 202, the rule edit module performs the 
actions detailed in FIG. 5. 

FIG. 3 is a picture of a rule editor used in accordance with 
one embodiment of the invention. The following descrip- 
tions of FIG. 4 and FIG, 5 may be enhanced by referring to 
FIG. 3. 

FIG. 4 is a flow diagram of a new rule portion of a rule 
edit module used in accordance with one embodiment of the 
invention. At step 204, a user specifies rule conditions, 
examples of which include restricting the values of the 



220. If the action is not permitted, the user is informed and 
can then select another action, or change the rule conditions. 

FIG. 5 is a flow diagram of an existing rule portion of a 
rule edit module used in accordance with one embodiment 
5 of the invention. As shown in FIG. 2, if the user wants to edit 
an existing rule, the agent manager performs the actions 
detailed in FIG. 5. 

As shown in FIG. 5, the agent manager tests whether there 
is any change in rule conditions at step 222. If there is, the 
lQ agent manager redefines the initial state at step 224 and must 
recheck the validity of the entire plan (as detailed in refer- 
ence to FIG. 7). The agent manager sets a condition flag at 
step 226, and tests whether the user has changed any actions 
at step 228. If at step 222 no changes in the conditions have 
been detected, the agent manager moves directly to test 
15 whether the user has changed any actions at step 228. If the 
user has not changed any actions at step 228, the agent 
manager checks whether the condition flag has been set at 
step 248. If it has, the agent manager resets the condition flag 
at step 238 and moves to rule analysis module 400. If the 



message type, sender, recipient, subject, and the date and 20 condition flag has not been set, the program waits for user 



time of arrival. By specifying these rule conditions, the user 
defines the set of messages to which the rule applies. For 
example, FIG, 3 shows a rule that applies to e-mail messages 
from Julia Hirschberg whose subject field contains the word 
"important." As the user specifies the conditions, the system 
continuously updates and displays the rule's context, i.e., its 
relationship to other rules and actions the rule will inherit 
from more general rules (as discussed in reference to FIG. 
6). 

The user can also specify using rule edit module 200 two 
types of conditions about the arrival date and time of 
messages. First, users may specify messages that arrive in a 
particular interval, such as "between 4:00 p.m. on Sep. 15, 
1995 and 8:00 a.m. on Sep. 20, 1995." The user can also 
specify intervals such as "from November 1995 to March 35 
1996," and "after 5:00 p.m. on Sep. 15, 1995." Second, the 
user can specify messages that arrive during a particular 
period, such as "during June, July and August," "on Satur- 
day or Sunday," "between 1800 and 0800," "on the first 
Monday of each month," and "on the last working day of the 
month." 

As the user enters the conditions at step 204, these 
conditions define an initial state. The initial state is the class 
of messages to which the actions apply. For example, the 
initial state for the rule in FIG. 3 is 



InSpool and 

messageType ■= email and 
sender = Julia-Hirshberg and 
subject contains "important". 



This initial state will be transformed as new actions add or 
delete facts from the initial state. 

At step 208, a user selects rule actions. In our e-mail 55 
example, the set of actions could include Move Message, 
Forward Message, Notify by Paging, Notify with Pop Alert, 
and so forth. As shown in FIG. 3, the rule contains a single 
action that moves messages to a folder named "julia." The 
system has determined that one rule named "Email" is more 60 
general, and that one action "Copy Message 'email archive, 
"' will be inherited to this rule (as discussed in reference to 
FIG. 6). 

At step 210, the agent manager tests whether the selected 
action is permitted by the system in the state in which the 65 
specified conditions and previous actions have been applied. 
If it is, the agent manager updates the current state at step 



input, or the termination of the agent manager. 

If the user changes an action at step 228, the agent 
manager tests whether the user added an action at step 230. 
If the user has added an action to the end of plan, all that 
25 must be checked is that action's applicability, i.e., the action 
is possible for the selected condition. Thus, at step 232 the 
added action is tested as to whether it is valid. If it is not, the 
user is prompted or directed to select another action. 
Alternatively, the user could select a condition that conforms 
30 to the action initially selected. If the action is valid, the agent 
manager updates the current state of the plan at step 234 and 
checks to see if the user changed any conditions by checking 
whether the condition flag was set at step 236. If no 
conditions were changed, this program module ends, or 
alternatively, allows the user to make additional edits to the 
existing or other rule plans. If the condition flag is set at step 
236, then the condition flag is reset at step 238 and the 
program module returns. 

If at step 230, the user did not add an action, the agent 
40 manager tests whether the user wants to delete or insert an 
action at steps 240 and 242, respectively. If either action is 
selected, the agent manager checks at step 244 whether the 
action is valid. If it is, the agent manager updates the current 
state of the plan at step 246, resets the condition flag at step 
4J 238, and returns. If the action is not valid at step 240 or 242, 
the program informs the user and prompts the user to 
perform another action. 

FIG. 6 is a flow diagram of a rule index module used in 
accordance with one embodiment of the invention. To better 
50 understand how the agent manager indexes rules, it may be 
helpful to first describe the representation and reasoning 
technology used by the invention. 

The rule representation used in the invention should 
enable three functions: 
55 1. Determine whether an action may apply in a given 
context, e.g., to a specified set of messages, or after 
certain other actions; 

2. Determine when one rule subsumes another, that is 
determine whether the set of objects to which the first 
rule applies is a superset of the set of objects to which 
the second rule applies; 

3. Determine when two rules intersect, that is determine 
whether the set of objects to which the first rule applies 
intersects the set of objects to which the second rule 
applies. 

One example of representing rules in accordance with the 
invention is through the use of CLASSIC, which is detailed 
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in a paper by A. Borgidaet al. titled "CLASSIC: A Structural AI planning research explores planning synthesis 

Data Model for Objects," SIGMOD '89, (1989), and a paper (creating a plan that transforms a specified initial stale to a 

by R. J. Brachman titled "Living with Classic: When and specified final state) and recognition (inferring an agent's 

How to Use a KL-ONE-Like Language," Formal Aspects of plan by observing his/her/its actions), both of which are very 

Semantic Networks, J. Sowa, Ed., Morgan Kaufmann, Los 5 difficult computational problems. By way of contrast, the 

Altos, Calif., 1990, both of which are herein incorporated by invention allows the user to construct a plan, i.e., the actions 

reference in their entirety. of a rule. Thus the agent manager need only check plan 

CLASSIC is a description logic. As such, it permits users validity, which is a much less expensive (in terms of CPU 

to create structured descriptions of sets of objects (known as cycles) computational task. 

concepts) and individual objects. As with any standard 1Q Thus, as shown in FIG. 6, the agent manager inserts the 

knowledge representation or object-oriented language, users new rule defined by the user into a rule hierarchy at step 302. 

may state hierarchical relationships between concepts. The One way to establish a rule hierarchy is to use CLASSIC, 

main service provided by CLASSIC, however, is to deter- The plan from parent rule PARENT is inherited to the new 

mine subsumption relationships automatically by analyzing pl an NEW and added at the proper position in NEW's plan 

concept descriptions. at ste p 304. NEW's plan is inherited to its child CHILD and 

Determining subsumption relationships is a key require- 15 inserted in the proper position, i.e., after the local plan of 

ment for the invention. The invention uses CLASSIC to ch^d md b ef ore the more general plan of PARENT, at 

automatically maintain a rule hierarchy. For example the ste 306 The intersection INXER of ^ w and its sibling 

conditions of the rule being edited in FIG. 3 would be mle srBLING is formed at step 308, and all the appropriate 

represented in CLASSIC as the following concept (referred , . , . , tkittt) f * l4 +L * * 

to as C V 20 P 115 are in ° ente " t0 INTER at step 310. It is worthy to note 

o) ' that the user only becomes aware of INTER if some action 

in its plan is defeated. All the composed plans are checked 

Co - messageType - email and for validity by rule analysis module 400, and whenever any 

sender - Mla-Hiiscbberg and actions of rule's plan are defeated, the display of the rule is 

subject contains "important" updated to reflect this fact. 

FIG. 7 is a flow diagram of a rule analysis module used 

Examples of concepts that subsume C 0 include concepts i° accordance with one embodiment of the invention, The 

formed from a subset of its conjuncts, such as rule analysis module 400 of the agent manager detects when 

"messageType=email" (the more general rule shown in FIG. a rule's plan is not valid, i.e., some action does not apply. 

3) or "sender=Julia-Hirschberg." The object hierarchy is This can occur either as a user edits a rule or when the rule 

use, so " message Type=Message" also subsumes C 0 . In is added to the hierarchy. When the agent manager finds an 

addition, the semantics of substrings are used, so a concept invalid plan, it computes repairs, which are changes to the 

like "subject contains 'port'" also subsumes C 0 . p i an that will make the plan valid. It then presents an 

CLASSIC also determines the intersection between two interactive explanation that explains the nature of the prob- 

concepls. This is useful because users often state general lem and the user in selecting a repair, 

rules that categorize messages by a single attribute, such as: 35 task of veri fy ing plan validity centers around the 

notion of current state. The conditions of a rule define an 
sender Mia- Hirechberg initial state that is the class of messages to which the actions 
subject contains "important," a ppty- Each action transforms the initial state by adding or 
4Q deleting facts. For example, the initial state for the rule in 

CLASSIC determines whether these rules intersect. The 15 

intersection between these two rules is the conjunction of the . 

two concepts. In general, however, CLASSIC may have to InSpool and 

combine parts of two concepts to determine the intersection. messageType = email and 

For example, consider the two descriptions of message 45 sender = Juiia-Hirshberg and 

arrival times "between 12:00 on Nov. 8, 1995 and 12:00 on subject contains ".mpottant." 

Nov. 10, 1995" and "between 18:00 and 8:00." CLASSIC 

determines that the intersection is "18:00 to 23:59 on_Nov. InSpool is a special tag indicating that the message has not 

8, 1995, midnight to 8:00 and 18:00 to 23:59 on Nov. 9, yet been disposed of, i.e., deleted or moved to a folder. All 

1995, and midnight to 8:00 on Nov. 10, 1995." 50 actions have at least one precondition — InSpool — which is 

Like rule conditions, rule actions are represented as the one fact in delete list of "Move Message." Thus, adding 

CLASSIC concepts. Actions are described in terms of a a "Move Message" action results in the removal of InSpool 

basic artificial intelligence (AI) planning model. Each action from the current state. If any other actions are subsequently 

applies in a particular "state of the world," represented as a added to the rule, the system will find that they do not apply, 

list of facts, and each action may change the state of the 55 The system has to update the current state whenever an 

world. Thus, an action is defined in terms of its precondi- action is added, deleted or inserted, or when the conditions 

tions (facts which must be true for the action to be applied), are changed, as described previously in reference to FIG. 5. 

add list (facts added by the actions), and delete list (facts When an action is added to the end of the plan, all that has 

deleted by the action). For example, the action PickupCall is to be checked is that action's applicability. Changing the 

defined as: 60 conditions redefines the initial state, so the validity of the 

whole plan must be rechecked. When an action is inserted 

— — — _ — — ^— into or deleted from the middle of the plan, the whole plan 

preconditions: TeJephoneCaii again jg checked. Alternatively, the checking could begin 

6dd - CaiiPickedup from the insertion/deletion point by keeping a record of 

65 previous states. 

If an action A a occurs in a plan before an action A^, and A 2 As a user edits a rule, the agent manager continuously 

deletes a precondition of A^ then A 2 defeats A^. recomputes its position in the rule hierarchy, thus determin- 
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ing the actions to inherit to the rule from more general rules. 
Either the locally defined or the inherited actions of a rule 
may be done first. If the user has not specified an order, the 
system will prefer the local-first ordering, but if this results 
in an invalid plan, it will try inherited-first. For example, in 5 
FIG. 3, if the local "Move Message" action were ordered 
before the inherited "Copy Message" action, the plan would 
be invalid, so the invention selected the inherited-first order- 
ing. 

When a rule is added to the hierarchy, the Agent Manager 10 
inherits its plan to all more specific rules. It also considers 
rules resulting from the intersection of the new rule and its 
sibling rules. These cases all result in new plans being 
composed, all of whose validity must be tested. Notice that 
users become aware of intersection rules only if their plans 15 
are invalid. 

After actions are inherited, the plan at each rule to which 
actions have been inherited must be checked for validity. 
These rules are (potentially) NEW, all descendants of NEW, 
and all INTER rules of NEW and its siblings. 

Thus, as shown in FIG. 7, rule analysis module 400 
compares NEW, CHILD and INTER conditions with con- 
ditions from existing rules OLD at step 402. If a NEW, 
CHILD or INTER condition and OLD condition are the 
same, or simultaneous, at step 404, the agent manager 
determines if the actions of NEW, CHILD or INTER and 2 5 
OLD conflict (as previously discussed). If they do conflict, 
the NEW or INTER plan is invalid, and rule analysis module 
400 moves to the next plan at step 410. If all plans are 
analyzed, risk analysis module 400 returns. If not, rule 
analysis module 400 processes the next plan from NEW, 3Q 
CHILD or INTER. 

At step 404, if the conditions of NEW, CHILD or INTER 
and OLD are not the same, the agent manager tests whether 
the conditions of NEW, CHILD or INTER and OLD inter- 
sect at step 414. If they do, the agent manager checks if the 35 
actions conflict at step 406. If the actions conflict, the NEW, 
CHILD or INTER plan is invalid at step 408, and rule 
analysis module 400 moves to the next plan. If at step 414 
the conditions of NEW, CHILD or INTER and OLD do not 
intersect, the plan is considered valid at step 412- 

FIG. 8 is a flow diagram of a first portion of a rule repair 
module used in accordance with one embodiment of the 
invention. When the agent manager detects that a rule has an 
invalid plan at step 502, it attempts to categorize the rule as 
one of a pre-defined set of invalid rule types at step 506. For 
example, the intersection of a rule that files messages by 45 
sender (e.g., "move messages from Tom to the folder Tom- 
Mail") and a rule that files messages by subject (e.g., "move 
messages with the subject 'RDDF to the folder RDDI- 
Project") constitutes a common type of problem. The benefit 
of categorizing problems is that multiple instances of a given 50 
category may occur as a user works, and the user may 
specify that all problems of a particular category should be 
repaired in the same way. 

When an action in a plan does not apply, the agent 
manager computes repairs at step 508, and generates an 55 
interactive dialogue that explains why the action does not 
apply and suggests repairs to the plan that will enable the 
action at step 510. How the agent manager computes repairs 
for a rule at step 508, and creates the interactive dialogue at 
step 510, is described in more detail as follows. 

The dialogue contains a component for each unsatisfied 60 
precondition of the action. The text is created by composing 
templates associated with actions, preconditions and plan 
modification operators. If a precondition was deleted by a 
previous action in the plan, the system looks for alternative 
actions whose add list is a superset of the defeating action 65 
and whose delete list does not contain the unsatisfied pre- 
condition. Consider the rule formed from the intersection of: 



messageType = email and 
sender = Julia-Hirschberg 

Move Message "julia", and 
messageType - email and 
subject contains "important" 
=*> Move Message "important". 



The two "Move Message" actions conflict with each other, 
since each deletes "Inspool" from the current state, and 
"InSpool" is a precondition of all actions. Since <e Copy 
Message" adds the same facts as "Move Message" (the 
message is filed), but does not delete "InSpool," substituting 
"Copy Message" for "Move Message" actions would result 
in a valid plan. The agent manager would prompt the user as 
follows: 



"Move Message" does not apply because of the 
effect of a previous "Move Message" action was 
to move the message out of the mail spool -- 
you can take care of this by replacing the 
previous "Move Message" action by "Copy 
Message". 
Do It 



If no action in the plan defeated an unsatisfied 
precondition, the system looks for actions that satisfy the 
precondition and do not defeat any other actions in the plan. 
Consider the rule: 



messageType - Message 

=> Play Greeting "Greeting 1". 



"Play Greeting" applies only to telephone calls, and only 
after a call has been picked up. Since the action "Pickup- 
Call" results in the call being picked up, inserting it into the 
plan would repair the second problem. The following mes- 
sage would be given to the user: 



"Play Greeting" does not apply because 

1) the current message is not a Telephone Call 
- you can take care of this by selecting the 
Message Type Telephone Call 

Do It 

2) the call has not yet been picked up you 
can take care of this by inserting the action 
"Pickup Call" before "Play Greeting" 

Do II 



The algorithm for computing repairs is thus: 



For each unsatisfied Action A 

For each unsatisfied precondition P 

If 3 in plan before A, and B deletes P 

Then Repairs = {B' such that B'.add D B.add & 

P D B'.delete} 
Else Repairs - {B' such that P £ B'.add & B' 
can apply before A & B' does 
not defeat any later actions} 



The agent manager visually indicates rules with invalid 
plans and problematic actions in each plan. A user may 
access the repair dialogue associated with an action by 
clicking on the action. After the user selects a repair, the 
system applies the repair, checks the validity of the plan 
again to see whether the status of any other actions has 
changed, and updates the repair dialogue to show the new 
status of the plan. 
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Returning to the operation of FIG. 8, the user selects a 
repair at step 512, and the agent manager applies the selected 
repair at step 514. The repaired plan is analyzed to ensure its 
validity at step 515, using rule analysis module 400 
described previously. If the repaired plan is valid at step 518, 5 
the current state for the repaired plan is updated at step 520. 
If the repaired plan is not valid at step 518, the agent 
manager generates another repair. 

FIG. 9 is a flow diagram of a second portion of a rule 
repair module used in accordance with one embodiment of 3Q 
the invention. If the repaired plan is valid at step 518, the 
agent manager checks whether the rule was a member of a 
problem category at step 522, and whether other rules also 
belong to the same category at step 524. In such cases, the 
agent manager asks whether the user wants to propagate the 
same repairs to all other rules in the category at step 526, and 15 
if so, applies the repairs to all plans within the same problem 
category at step 528. Once all the repaired plans are checked 
at step 530, the agent manager checks if all plans are 
checked at step 504 (shown in FIG. 8), and if so, returns. If 
not, the agent manager repairs the next plan. If all repaired 20 
plans are not checked at step 530, the agent manager 
processes the next repaired plan. 

It can be appreciated by one skilled in the art that any 
software programs, schemes, steps or algorithms described 



4. The method described in claim 3, wherein said rule is 
placed in said hierarchical order using CLASSIC, 

5. A method for a user to program a personal software 
agent using an agent manager, wherein said agent manager 
is connected to an input device for receiving instructions 
from the user, comprising the steps of: 

creating a rule by denning said rule's conditions, 
attributes and actions; 

placing said rule in an hierarchical order comprised of 
parent rules, child rules, sibling rules, and inter rules, 
wherein said rule inherits actions from said parent 
rules, wherein said child rules inherit actions from said 
rule, and said inter rules inherit actions from the 
intersection of said rule and said sibling rules; 

determining whether said rule is valid within said hierar- 
chical order; and 

suggesting repairs to said rule if said rule is invalid. 

6. The method described in claim 5, wherein said rule is 
placed in said hierarchical order using CLASSIC and 
CLASSIC determines subsumption relations among rules. 

7. The method described in claim 6„ wherein CLASSIC 
determines intersections among rules. 

8. The method described in claim 7, wherein said action 
is defined in terms of preconditions, add list and delete list 
for said action. 

9. The method described in claim 8, wherein said rule is 



herein with reference to an embodiment of the invention can 2 s repaired using an interactive dialogue explaining why said 



be implemented in either hardware or software. If imple- 
mented in software, these software programs, schemes, steps 
or algorithms can be implemented on any general purpose 
computer, such as a personal computer, or special purpose 
computer, such as a digital signal processor (DSP), having 3Q 
at a minimum a processor with sufficient processing speed, 
and a computer readable medium such as read-only memory 
(ROM), programmable ROM (PROM), erasable program- 
mable ROM (EPROM), random access memory (RAM), 
hard drive, optical drive, floppy disk, and so forth. 

35 

Conclusion 

Although a preferred embodiment is specifically illus- 
trated and described herein, it will be appreciated that 
modifications and variations of the present invention are 
covered by the above teachings and within the purview of 40 
the appended claims without departing from the spirit and 
intended scope of the invention. For example, although the 
rule hierarchy is defined using CLASSIC, it can be appre- 
ciated that any mechanism for creating structured descrip- 
tions of sets of objects and individual objects falls within the 45 
scope of the invention. Another example is the rule editor 
used by rule edit module 200, and shown in FIG. 3. It can 
be appreciated that any editor allowing the definition of 
conditions, attributes and actions, or combinations thereof, 
falls within the scope of the invention. 

What is claimed is: 50 

1. A method for a user to program a personal software 
agent using an agent manager, wherein said agent manager 
is connected to an input device for receiving instructions 
from the user, comprising the steps of: 

creating a rule to control the personal software agent; 55 
placing said rule in a hierarchical order of rules to control 

the personal software agent; 
determining whether said rule conflicts with another rule 

within said hierarchical order; and 
suggesting repairs to said rule if said rule conflicts with 60 

another rule. 

2. The method described in claim 1, wherein the user 
creates said rule by defining conditions, attributes and 
actions of said rule. 

3. The method described in claim 2, wherein said hierar- 65 
chical order is comprised of parent rules, child rules, sibling 
rules, and inter rules. 



action does not apply and suggesting repairs to said rule that 
will enable said actions. 

10. The method described in claim 9, wherein said invalid 
rule is categorized according to why said rule is invalid. 

11. The method described in claim 10, wherein repairs 
applied to said invalid rule are applied to rules in the same 
category as said invalid rule. 

12. An agent manager for a personal software agent, the 
agent manager having an input device for receiving instruc- 
tions from a user, comprising: 

a rule edit module having a rule edit input coupled to the 
input device for receiving instructions from the user for 
creating a rule to control the personal software agent 
and having a rule edit output; 

a rule index module having a rule index input coupled to 
said rule edit output for receiving said rule and placing 
said rule in a hierarchical order of rules to control the 
personal software agent, and having a rule index out- 
put; 

a rule analysis module having a rule analysis input 
coupled to said rule index output for receiving said 
hierarchical order and using said hierarchical order for 
determining whether said rule conflicts with another 
rule in the hierarchical order, and having a rule analysis 
output; and 

a rule repair module having a rule repair input coupled to 
said rule analysis output to receive said rule if said rule 
conflicts with another rule in the hierarchical order in 
order to guide the user in selecting and applying repairs 
to avoid the conflict. 

13. The agent manager described in claim 12, wherein 
said rule edit module allows the user to enter conditions, 
attributes and actions to define said rule. 

14. The agent manager described in claim 13, wherein 
said hierarchical order is comprised of parent rules, child 
rules, sibling rules, and inter rules. 

15. The agent manager described in claim 14, wherein 
said rule index module permits the user to create structured 
descriptions of sets of objects and individual objects. 

16. The agent manager described in claim 15, wherein 
said rule index module represents said rule using CLASSIC. 

17. An agent manager for a personal software agent, the 
agent manager having an input device for receiving instruc- 
tions from a user, comprising: 
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a rule edit module having a rule edit input coupled to the 
input device for receiving instructions from the user for 
creating a rule by entering conditions, attributes and 
actions to define said rule, and having a rule edit output; 

a rule index module having a rule index input coupled to s 
said rule edit output for receiving said rule and placing 
said rule in a hierarchical order comprised of parent 
rules, child rules, sibling rules, and inter rules to create 
structured descriptions of sets of objects and individual 
object, and having a rule index output and wherein said 
rule index module inherits actions from said parent 10 
rules to said rule, inherits actions from said rule to said 
child rules, and inherits actions from the intersection of 
said rule and said sibling rules to said inter rules; 

a rule analysis module having a rule analysis input 
coupled to said rule index output for receiving said ^ s 
hierarchical order and using said hierarchical order for 
determining whether said rule is valid, and having a 
rule analysis output; and 

a rule repair module having a rule repair input coupled to 
said rule analysis output to receive said rule if said rule 20 
is invalid in order to guide the user in selecting and 
applying repairs to make the rule valid. 

18. The agent manager described in claim 17, wherein 
said rule index module determines subsumption relations 
among rules. 25 

19. The agent manager described in claim 18, wherein 
said rule index module determines intersections among 
rules. 

20. The agent manager described in claim 19, wherein 
said action is defined in terms of preconditions, add list and 
delete list for said action. 

21. The agent manager described in claim 20, wherein 
said rule repair module creates an interactive dialogue 
explaining why said action does not apply and suggests 
repairs to said rule that will enable said actions. 

22. The agent manager described in claim 21, wherein 35 
said rule repair module categorizes invalid plans according 

to why said plans are invalid. 

23. The agent manager described in claim 22, wherein 
said rule repair module applies said repairs to rules in the 
same category as said invalid rule. 40 

24. Apparatus for automatically verifying whether a new 
rule which is to be added to a set of rules to control a 
personal software agent is valid with respect to the set of 
rules, each rule specifying a set of conditions and a sequence 



to the set of rules, each rule specifying a set of conditions 
and a sequence of actions being interpreted in a system 
which causes the actions specified in the rule to be per- 
formed when the conditions specified in the rule are 
satisfied, the apparatus comprising: 

a stored subsumption hierarchy of the rules in the set of 
rules; 

means for placing the new rule in the subsumption 
hierarchy; 

means for using the subsumption hierarchy which 
includes the new rule to determine whether the new 
rule is valid, and provide an indication of invalidity 
when the new rule is not valid and further using the 
subsumption hierarchy to determine a suggested cor- 
rection for the new rule when the new rule is not valid 
and provide the suggested correction, wherein the 
means for using the subsumption hierarchy determines 
whether the new rule is valid by using the subsumption 
hierarchy to determine whether the conditions of the 
new rule and another rule of the set of rules can apply 
simultaneously and if the conditions do so apply, ana- 
lyzing the actions of the rules for conflicts; and 

comprising means responsive to an input from a user of 
the apparatus indicating acceptance of the suggested 
correction for correcting the new rule according to the 
suggested correction. 

27. The apparatus described in claim 26, wherein the 
means for using the subsumption hierarchy determines 
whether the conditions of the new rule and another rule can 
apply simultaneously by using the subsumption hierarchy to 
determine whether the condition of one of the rules is more 
general than the condition of the other or whether the 
condition of one of the rules intersects with the condition of 
the other of the rules. 

28. The apparatus described in claim 27, wherein the 
means for using the subsumption hierarchy further uses the 
subsumption hierarchy to determine a category for a sug- 
gested correction which has been accepted and find other 
rules which require corrections belonging to the category. 

29. The apparatus described in claim 28, wherein the 
means for placing the new rule in the subsumption hierarchy 
does so each time the new rule is altered. 

30. Interactive rule editing apparatus for editing a rule 
which is to be added to a set thereof, each rule specifying a 
condition and an action and being interpreted in a system 



of actions being interpreted in a system which causes the 4S which causes the action specified in the rule to be performed 
actions specified in the rule to be performed when the when the condition specified in the rule is satisfied, the 
conditions specified in the rule are satisfied, the apparatus 
comprising: 

a stored subsumption hierarchy of the rules in the set of 
rules; 

means for placing the new rule to control the personal 

software agent in the subsumption hierarchy; and 
means for using the subsumption hierarchy which 

includes the new rule to determine whether the new 

rule conflicts with another rule in the hierarchy and 

provide an indication when a conflict exists, 
wherein the means for using the subsumption hierarchy 

further uses the subsumption hierarchy to determine a 

suggested correction for the new rule when the new 

rule conflicts with another rule and provide the sug- 
gested correction. ( 

25. The apparatus described in claim 24, further compris- 
ing means responsive to an input from a user of the appa- 
ratus indicating acceptance of the suggested correction for 
correcting the new rule according to the suggested correc- 
tion, i 

26. Apparatus for automatically verifying whether a new 
rule which is to be added to a set of rules is valid with respect 



when the condition specified in the rule is satisfied, 
interactive rule editing apparatus comprising: 

input means; 

output means; 

means for determining whether the rule to be added to 
control the personal software agent conflicts with 
another rule with regard to the set thereof and if the rule 
to be added does conflict, providing a suggested cor- 
rection; 

means for altering the rule; and wherein 

the input means receives the rule to be added and 
provides the rule to be added to the means for 
determining; 

the output means receives the suggested correction and 
outputs the suggested correction; 

the input means receives an indication that the sug- 
gested correction has been accepted; and 

the means for altering the rule responds to the indica- 
tion by altering the rule to be added in accordance 
with the suggested correction. 
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METHOD AND APPARATUS FOR 
PROVIDING BOOKMARKS WHEN 
LISTENING TO PREVIOUSLY RECORDED 
AUDIO PROGRAMS 

BACKGROUND OF THE INVENTION 
The present invention is directed to providing a bookmark 
for audio programs. In one embodiment an audio service 
includes the capability of creating a user bookmark to enable 
a user to proceed through an audio program at that user's 
own pace. 

It is known to provide telephone-based audio services 
over, for example, the Public Switched Telephone Network 
(PSTN). For example, it is known to provide call up services 
where a service user dials a particular number through the 
PSTN to obtain information. One example of such a service 
is a "900" service that enables a user to call a "900" number 
and receive the day-to-day comments of a celebrity or sports 
personality. Similarly, it is possible to provide an audio 
service in which the user will dial a designated number and 
have audio program information, such as news summaries, 
played back to the user through the PSTN. 

The presently available audio services are somewhat 
limited in nature. In particular, audio-based services that 
provide serial information are not as powerful as they could 
be because the user is not provided with a way to select the 
appropriate pace with which they will proceed through the 
material. For example, there presently is no flexibility pro- 
vided to the user for selecting a start point, or more impor- 
tantly a restarting point if the user accesses a given audio 
service multiple times. In a typical service, if the user 
chooses to disconnect from the service at any point prior to 
the completion of the program material, the call terminates 
and the service takes no note of where or when the user 
terminated the access to the service. Connect time may be 
monitored for billing purposes, but no correlation is drawn 
to the user's progress through the audio program. If the user 
later reconnects to the service, the program material is cued 
to its initial starting point and the user must listen to the 
entire portion of the program material which was accessed 
earlier before returning to the point at which the service had 
earlier been terminated. 

The present construction of these services limits their 
usefulness in providing audio services, such as audio books 
or audio "soap operas", since there is no possibility of 
quickly returning to the point at which the user had previ- 
ously terminated the service. The user is discouraged from 
re-accessing such services. 

For example, the user could with some difficulty return to 
the same part of a story or soap opera, at the cost of having 
to listen to the same program material again before proceed- 
ing on to new material. Thus, it would be advantageous if 
there were some technique provided for allowing a user to 
enjoy the audio services at a pace set by the user. 

A similar problem arises in the context of audio program 
material that can be downloaded from a network audio 
service, e.g., a music program could be accessed via the 
Internet and downloaded to a user's PC. Upon playback of 
the program the user may decide to stop playing the program 
to pursue some other interest. It would also be advantageous 
if the PC could provide a technique for automatically 
positioning the playing back of the downloaded program to 
avoid having to search for the desired re-starting point. 

SUMMARY OF THE INVENTION 
The present invention provides a "bookmark" that permits 
a user who is reviewing audio program material to stop at 
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any point in the program and to resume the review at the 
point at which the user previously stopped. 

In accordance with an embodiment of the present 
invention, a user can access an audio information services 

5 platform through the PSTN. The platform has an audio 
content (program) database and a personal profile database. 
The user has an assigned user code. When the user connects 
to the audio information service platform, the user code is 
utilized to access information stored in the personal profile 

30 database. The stored information identifies the services 
previously accessed by the user and identifies the location 
within each audio service at which the user has previously 
terminated the service. The user can then select a desired 
audio service and request to be returned to the location in the 

15 audio service at which the previous access had been termi- 
nated. 

In accordance with the embodiment the bookmark is 
generated by monitoring or tracking the progress of the user 
in reviewing the program material. In particular, a playback 
20 module may be coupled to a position location detector such 
as a block counter or timer. When the user terminates the 
access, the user ID, a service identifier and a last position 
location are grouped and stored in the personal profile 
database for later use. 

25 

By providing a bookmark for the audio services the user 
can better access and utilize audio books, multi-step pro- 
grams such as stop-smoking programs, audio soap operas, 
travel direction services, or any serial presentation of infor- 
30 mation that lends itself to self-pacing by the user. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 discloses an audio information service system in 
accordance with an embodiment of the present invention. 
35 FIG. 2A illustrates a flowchart for creating a bookmark in 
the audio service system of FIG. 1 in accordance with an 
embodiment of the present invention. 

FIG. 2B illustrates a flowchart for using a bookmark 
created in FIG. 2A. 

40 

DETAILED DESCRIPTION 

FIG. 1 illustrates, in block diagram form, a system for 
providing au audio information service that includes book- 

45 marks. The service provider has an audio information ser- 
vice platform 103 which is accessible through a Public 
Switch Telephone Network (PSTN) 102. Typically in such 
circumstances the platform is accessible by dialing a par- 
ticular number, e.g., 800-XXX-YYYY, that is associated 

so with the platform, The user can access the platform through 
the PSTN simply using the telephone 101, The telephone 
will include a keypad which enables the user to enter 
alpha-numeric codes represented by DTMF signals that can 
be transmitted through the PSTN 102 to the audio informa- 

55 tion service platform 103. One known audio services plat- 
form that does not include the bookmark capability is the 
CONVERSANT® system, belonging to Lucent 
Technologies, Inc. 

In the present invention the platform 103 includes not 

60 only a database for audio content, 104 but a personal profile 
database 105 that stores information about the users of the 
service. A service controller 107 is a processing device 
which has the capability of controlling accesses to the 
personal profile database to obtain information about the 

65 users that are accessing the service platform. Alternatively, 
the service controller can arrange to have information about 
a user stored in their personal profile database 105. 
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The service controller 107 also interfaces with a program prompts. The service menu module reports the selection of 

retrieval and playback module 109. This module is respon- the audio service to the service controller 107 and in turn, the 

sible for accessing audio from the audio content database controller activates the playback module to request a play- 

104 under the specific instructions of the service controller. oack of the desired audio service, step 203. The program 

For instance, the service controller will provide information 5 retrieval and playback module 109 then acts upon the 

to the module as to which audio content to obtain as well as request from the service controller to access the audio 

identify the location within the audio content at which the content database 104 to select the desired audio service in 

service should begin. Typically each service will have an accordance with the service ID associated with the selected 

associated identifier or code that uniquely identifies the service. The playback module 109 then can check the 

service and/or content. The service controller then arranges 10 selected program for length, step 204. This can be done for 

for the playback audio service to be routed to the appropriate instance by checking the file length or length information 

user through the PSTN 102 to the user's telephone 101. could be encoded into a header, for example. It may be 

The service controller also interfaces with a service menu d ^rmined in advance that certain programs are too short to 

module 108 that provides information about the available w * n ™\ Fading bookmarks to the user so that only 

audio services in the audio content database. Under the 15 selected programs wiU provide the bookmark capability. If 

control of the combination of the service controller and the *?" 15 c f e ' ^n having obtained the information iden- 

service menu module the user, upon connection to the t^g. length of the program the playback module 

platform, is given information about the available services determines whether the program is long enough to warrant 

and, as is described below, can be instructed about options bookmarks, step 205. If the module detects that the service 

for resuming previously accessed audio services. 20 ^ not ong enough to warrant bookmarks then the module 

_ . „ , , , . , ^ will playback the program in the normal way without 

The service controller could also interface with an Auto- ,„ M .„„ ,l 0 „„ ,„ ° „„ «, t , „ + -, nj£ 

. ^ , „ .. TI . s . f-m i-. ^ ,. , tracking the user s progress through the program, step 206. 

matic Speech Recognition Unit (ASR) which operates to , f . b \ 7 . . r , t \ ,f , ' F 

detect voice responses by the users to menu prompts, rather . f ' hoWever ' ' he Payback module detects hat the program 

than detecting keypad or DTMF responses, enough to warrant bookmarks, the playback module 

^ . „ -M , . „ T ^ 25 fetches the first block of the audio program and records the 

^ S SE°l C ? ntr0lter 107 also . inter f aces Wllh a us *\ D block number in the block counter 110 in step 207. As 
mO ^ e / 06 '? ls ^ me f lon P ro "f^ me f^ ceMntr ° 11 1 J r playback of a given block of the audio program is 
wjth information about the user including the identity of the completedj the p i ayb ack module fetches the next block in 
user for use together with the personal profile database. User me Qce and b ing tQ k - t wfaile datin ^ 
IDs are well known. One possibility for a user ID is the 3Q of the block cmmter to zwm tfaat the counter maintains an 
detection of the automatic number ^formation (AMI) which accurate of the block now ^Ived in me j 
can be transmitted by the PSTN 102 and which identifies the back ^ ste Mm simultaneously, the service control- 
telephone number associated with the line connected to the ler mntiDU0us] monilOTS for a user request to end the 
user s telephone. Alternatively the user can be prompted to 2Q9 ^ usef cm ^ terminate the pro _ 
provide a personal ID or a PIN so that the user can access 35 b selection of ified k on ^ usef tel hone 
the audio service from any location rather than be limited to k d or can sim l fa , f mc usef ^ s|ffl to 
accessmg it from one particular telephone. the program „ detected m step 21Q then the operation 

Finally, the audio information service platform 103 also recycles through steps 208 and 209 to ensure that the user 

includes a position detector, shown as a block counter in this continues to get additional blocks of the audio service and 

embodiment, which is used in conjunction with the playback ^ that the location of the user through the service is constantly 

module 109 to monitor the user's progression through the monitored. If, however, the user is no longer listening to the 

audio service. The block counter provides useful informa- program, then the service controller notifies the playback 

tion about where the user is in a selected audio service at any module to terminate the playback, step 211. At the time of 

given time. This present position location information is termination the playback module passes the last recorded 

then detected and associated with a user when the user 45 block number stored in the block counter as well as the 

terminates an audio service. The service controller can then program ID for the service in use to the service controller, 

provide the user information (user ID), service identification slep 212. The service controller then takes the location 

information (service ID) and termination location informa- information and the program information and combines it 

tion to the personal profile database at the time the user t h e customer or user ID which is detected in step 201 

terminates a service. 50 an( j recG rds this information in the personal profile database 

The entire audio service platform is operated with the 105 for future reference, step 213. 

service controller 107 operating under the control of a stored The creation of the bookmark is variable depending upon 

program for accessing the audio services, creating a book- the type of program that is being provided to the user, 

mark and using an existing bookmark. The accessing of Different types of programs lend themselves to different 

audio services itself is well known. However, the creation of 55 ways to monitor the user's progress through the program, 

a bookmark and the use of an existing bookmark is described For example, in a book environment it may be desirable to 

below with reference to the flowcharts in FIGS. 2A and 2B. keep track of the user's progress through the book in terms 

One potential embodiment for creating a bookmark is of blocks that relate to either chapters, pages, or paragraphs, 
described by the flowchart of FIG. 2A. In accordance with Then, as each element, for example paragraph, is accessed, 
this operation, a customer first accesses the audio informa- eo the block counter is increased by one so that the system 
tion service platform through the PSTN and the platform keeps track of which paragraph in the presentation the user 
identifies the user either by detecting the ANI or by prompt- is presently located. Alternatively, the program may be a 
ing the user to enter a PIN, step 201. The user then is multi-step improvement program, e.g., a stop-smoking pro- 
provided with an interactive service menu and selects an gram. In such a circumstance, it may be beneficial to detect 
audio program from the menu, step 202. The interactive 65 the user's progress through the individual steps. In that case 
service menu can operate in conjunction with an ASR and/or the blocks referred to in connection with FIG. 2A may in 
a DTMF detector to detect the user's responses to the menu fact, correspond to the steps (or sub-steps) through the 
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process or program. Additionally, it may be advantageous to 
detect the actual elapsed time of the audio program. This 
would be applicable to the actual playback of a continuous 
program where the system monitors the time (the number of 
minutes and seconds) that the user has progressed into the 
audio file. Therefore, the block counter 110 could be 
replaced by a timer and the timing information associated 
with the location of the user through the audio content could 
be then provided to the service controller at the time of 
termination. Then the timing information would be stored 
with the program ID, and the user ID in the personal profile 
database. 

FIG. 2B illustrates a flowchart for use of the bookmark in 
connection with providing the audio service. 

At the starting point the customer dials the audio infor- 
mation service via the PSTN, step 221. The system answers 
the user's call and the service controller 107 activates the 
user ID module to detect the identity of the user, step 222. 
As described above, the user module can either use ANI or 
the PIN specifically entered by a user to identify the user, 
step 223. The service, controller then queries the personal 
profile database to verify the user ID and to determine 
whether any bookmarks exist and to determine, based on 
past experience with the user, whether the user has any 
particular audio service preferences, step 224. The controller 
then detects whether any bookmarks exist for the user in 
decision step 225 . If no bookmarks exist for the user then the 
service controller calls the service menu module with a 
standard non-bookmark menu similar to the menu which 
was referred to above in connection with FIG. 2A, step 226. 
That menu provides the user with an identification of the 
audio information services that are available through that 
platform. The service module then plays the standard menu, 
step 227 and the process continues from step 203 of FIG. 
2A. 

If, however, the service controller detects that a bookmark 
has been created for this user then the service controller 
retrieves the program or programs with bookmarks and the 
specific bookmark values from the personal profile database, 
step 230. The service controller can then pass the identifi- 
cation information regarding the previously accessed ser- 
vices in which bookmarks exist to the service menu module, 
step 231. The service menu module then can (step 232): play 
a special menu that includes the programs that have book- 
marks associated therewith; and, provide the user with the 
option of continuing the program from where the user last 
left off or to start the program from the beginning. In one 
embodiment the user indicates the choice by activating a 
corresponding key of the user's keypad to indicate the 
selection of the program and to select the location to begin 
playback of the program. The service menu module then 
indicates which selections the user has made, step 233. If the 
user has opted to begin a program from the beginning rather 
than from the place where the previous access was 
terminated, then the service controller instructs the playback 
module to play the program from the beginning, step 234, 
and the process continues from step 207 of FIG. 2A. If the 
user has indicated a desire to continue the program from 
where they last left off, the service controller passes the 
bookmark value to the playback module with the instruction 
to play the program from the bookmark, step 235. The 
playback module uses the bookmark value to index a point 
in the program where the user left off. The playback module 
then requests the next block of program from the audio 
content database, step 236. As indicated above, if the incre- 
ments of the program are in time increments or step 
increments, the playback module would then proceed to 
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mark the restart location according to the time or step 
information provided with the bookmark value. The play- 
back module then begins to play the program from the 
bookmark and starts the block tracking or location monitor- 

5 ing for bookmark updates by carrying out the process from 
step 208 of FIG. 2A onward, step 237. 

Of course, if the user selects a new service for which a 
bookmark has not yet been created, the operation of the 
system would continue from step 203 of FIG. 2A. 

10 The above block diagrams and flowcharts show one 
embodiment for a system that provides audio services and 
creates and uses bookmarks in connection with providing 
those audio services. It should be recognized that various 
modifications to the embodiment are possible. For instance, 

15 it is possible that the service will be a revenue generating 
service. In such a circumstance the user may be prompted to 
enter information not only identifying the user but also may 
be prompted to provide information for billing purposes. 
This billing information can also be stored in the personal 
profile database. Of course, the user ID and billing infor- 

20 mation codes can be one and the same. As indicated above, 
the user may have the capability of indicating user prefer- 
ences for types of audio services. This preference informa- 
tion can also be stored in the personal profile database and 
used to construct the appropriate menu to be provided by the 

25 service menu module. Similarly, it should be noted that the 
present invention is not limited to user telephones over a 
PSTN. Any kind of network that will support audio services 
can be an appropriate transmission medium for the audio 
service from the platform to the user (for example, a wireless 

30 network). Similarly, the user may employ a PC or other 
device or personal appliance to access the audio information 
service with, e.g., appropriate user ID information. As an 
example of an alternative application, a user may access an 
audio program or service via the Internet. In such a 

35 circumstance, available bandwidth may limit the viability of 
real-time audio program presentation. Thus, the more appro- 
priate presentation would involve first downloading the 
program material to the user's PC where it would be stored 
for playback. Once the user begins to playback the program 

40 the PC could monitor the progress through the program 
material and generate the appropriate bookmark in a manner 
consistent with the techniques described above. Then when 
the user terminates the program and subsequently returns 
they will be given the option of where to re-start the 

45 program. The termination and creation of a bookmark are 
distinct from a pause functionality in that the termination 
actually releases the program and ends its execution. The 
pause function keeps the program indefinitely cued. Thus, 
the bookmark would be useful in this environment as well. 

50 All of these capabilities are ancillary to the invention and 
are different techniques for employing that invention. The 
invention provides the capability of the user to proceed 
through an audio program at the user's own established pace 
and to return to the program and to the last location in the 

55 service at will. As a consequence, it provides the capability 
for creating and utilizing audio services that contain serial or 
continuous information in a more user friendly manner. 
What is claimed is: 

1. A method of facilitating a user's review of previously 
60 recorded audio program material over at least two review 
sessions, the audio program material having been commu- 
nicated to the user over a communication network, the 
method comprising the steps of: 

monitoring a user's progress in the user's review of audio 
65 program material during a first review session; and 
when the user terminates the first review session, storing 
in a memory associated with the audio program mate- 
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rial an indication of the user's progress in reviewing the 
audio program material during said first review session, 
wherein said stored indication can be utilized in a 
second review session subsequent to the termination of 
said first review session. 5 

2. The method of claim 1, further comprising the step of 
an audio program service furnishing said audio program 
material to said user over a communication channel. 

3. The method of claim 2, wherein said communication 
channel comprises a data network. 10 

4. The method of claim 2, wherein said communication 
channel comprises a telephone network. 

5. The method of claim 2, wherein said communication 
channel comprises a wireless communication channel. 

6. The method of claim 1, wherein said steps are imple- is 
mented by a user's personal appliance. 

7. The method of claim 6, wherein said audio program 
material is stored on CD-ROM. 

8. The method of claim 1, wherein said steps are imple- 
mented by a communications network-based service. 20 

9. A method of facilitating a user's review of previously 
recorded audio program material over at least two review 
sessions, the audio program material having been commu- 
nicated to the user over a communication network, the 
method comprising the steps of: 25 

monitoring a user's progress in the user's review of audio 
program material, said monitoring performed during a 
first audio program review session; 

when the user terminates the first audio program review 
session, storing in a memory associated with the audio 30 
program material an indication of the user's progress in 
reviewing the audio program material during said first 
audio program review session; 

in a second audio program review session subsequent to 
the termination of said first audio program review 35 
session, playing said audio program material to said 
user beginning from a position within said material 
based on said stored indication. 

10. The method of claim 9, further comprising the step of 

an audio program service furnishing said audio program 40 
material to said user over a communication channel, 

U. The method of claim 10, wherein said communication 
channel comprises a data network. 

12. The method of claim 10, wherein said communication 
channel comprises a telephone network. 45 

13. The method of claim 10, wherein said communication 
channel comprises a wireless communication channel. 

14. The method of claim 9, wherein said steps are 
implemented by a user's personal appliance. 

15. The method of claim 14, wherein said audio program 50 
material is stored on CD-ROM. 

16. The method of claim 9, wherein said steps are 
implemented by a communications network-based service. 

17. A method of creating a bookmark for use with an 
audio service that provides previously recorded sequential 55 
audio information comprising the steps of: 

associating a user code with a user of the audio service; 
monitoring a present location of the user in a sequence of 

audio information in an access to the audio service; fiQ 
detecting a termination of the access to the audio service; 
creating a termination code defining the present location 

of the user in said sequence at the time the termination 

is detected; 

correlating the user code and the terminatng code; and 65 
storing the result of said correlating step in a memory 
associated with the audio service for later use. 



18. The method of claim 17, wherein a service identifying 
code is associated with each audio service; and said step of 
correlating further includes the step of associating a service 
identifying code with said user code and said termination 
code. 

19. The method of claim 17, wherein said step of moni- 
toring comprises the steps of loading a register with an 
initialization value at the start of the service and updating the 
register as the audio information is presented. 

20. The method of claim 19, wherein said audio infor- 
mation is divided into discrete blocks of information and 
wherein said step of updating includes the step of revising 
the contents of said register to hold a block identifier 
corresponding to the block of information being conveyed 
by the service at that time. 

21. The method of claim 19, wherein said register stores 
the time elapsed from the beginning of the providing of the 
audio information. 

22. A method of providing audio services using a book- 
mark comprising the steps of: 

generating a menu of a plurality of audio services; 
detecting a selection of one of said plurality of audio 
services; 

transmitting previously recorded audio information from 
the selected audio service; 

monitoring a user's position in the selected audio service 
as the corresponding audio information is transmitted; 

detecting a termination of the selected audio service that 
occurs prior to completion of said service; 

creating and storing in a memory associated with at least 
oDe of said plurality of audio services a bookmark that 
identifies a user, the selected service and the user's 
position in the selected service at the time of termina- 
tion; 

subsequently accessing said bookmark; and 
returning the user to the location of the selected service 
based on said bookmark. 

23. The method of claim 22, wherein said selected audio 
service comprises a plurality of discrete blocks of audio 
information, each block having a unique block identifier 
wherein said step of tracking comprises the step of tempo- 
rarily storing the block identifier of a discrete block of audio 
information as that information is transmitted. 

24. The method of claim 22, wherein said step of moni- 
toring comprises the step of monitoring an elapsed time 
from a time at which said transmitting step begins. 

25. An audio information service platform for providing 
previously recorded audio information over at least two 
review sessions comprising: 

an audio content database; 
a personal profile database; 

a program playback module coupled to said audio content 
database; 

a playback position monitor coupled to said program 
playback module; and 

a service controller utilizing a user identifier, and storing 
an audio content identifier and a playback position 
identifier with said user identifier in said personal 
profile database in response to termination of a first 
review session, wherein said playback position identi- 
fier indicates a user's progress in reviewing audio 
information during said first review session and can be 
utilized in a second review session subsequent to the 
termination of said first review session. 

26. The platform of claim 25, wherein said audio content 
database stores an audio information for a plurality of audio 
services. 
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27. The platform of claim 26, further comprising a service service controller searches said personal profile database for 
menu module, coupled to said service controller and iden- data relating to an identified service user. 

tifying an audio service in said audio content database that 30. The platform of claim 29, wherein said service con- 
is desired by a user. troller is coupled to said program playback module to 

28. The platform of claim 27, wherein said service menu 5 initiate a resumption of an audio program at a location 
module advises said service controller of a desired starting defined by a playback position identifier associated with an 
point for an identified audio service, identified service user in said personal profile database. 

29. The platform of claim 25, further comprising a user ID 

module that identifies a service user and wherein said ***** 
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[57] ABSTRACT 

An asymmetrical data communications system (ADCS) pro- 
vides point- to-multipoint television programming including 
conventional television programming, near video-on- 
demand (NVoD) or video-on-demand (VoD), and the full 
variety of available programming, via a compressed, digi- 
tized UHF transmission. A program subsystem of the ADCS 
receives programming from content providers and processes 
the received signals for channel and VoD or NVoD service, 
then sends the aggregated signal to a transmission subsystem 
that modulates, channelizes, amplifies, filters and broadcasts 
the digital UHF signals over the air. Subscribing viewers are 
equipped with an intelligent control box (ICB) suitably 
configured to receive, demodulate, and decode the digital 
UHF broadcast and to transmit the resulting signal to one or 
more display or other terminal devices. The ICB further 
provides a matrix switch or gateway for receiving signals 
over any available transmission path. In addition to the ICBs 
of the subscribing viewers, a return path subsystem of the 
ADCS system includes a session control and administrative 
facility to which the ICBs are linked via the public switched 
telephone network or suitable wireless alternative so that 
transaction and viewing data can be received from the 
subscribing viewers. The return path subsystem, in turn, is 
linked to the program subsystem in order to route to that 
subsystem any information necessary or useful for providing 
programming. 

31 Claims, 9 Drawing Sheets 
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THE PARTIES 

3. Plaintiffs AT&T Intellectual Property I, L.P. and AT&T Intellectual Property II, 
L.P. are Nevada limited partnerships with headquarters in Atlanta, Georgia. 

4. Defendant TiVo Inc. is a Delaware corporation with a principal place of business 
at 2160 Gold Street, Alviso, California 95002. 

JURISDICTION 

5. This Court has subject matter jurisdiction over this dispute pursuant to 
28 U.S.C. §§ 1331 and 1338(a). 

6. This Court has personal jurisdiction over Defendant TiVo, which has conducted 
and continues to conduct business in the State of California and in this Judicial District. 
Defendant TiVo's principal place of business is within this Judicial District, in Alviso, 
California. Defendant TiVo has committed acts of patent infringement alleged herein within the 
State of California and, more particularly, within this Judicial District. Moreover, Defendant 
TiVo has purposefully and voluntarily placed its infringing products, processes, and services into 
the stream of commerce with the expectation that they will be purchased by consumers in this 
Judicial District. These infringing products, processes, and services have been and continue to 
be purchased by consumers in this Judicial District. 

VENUE 

7. Venue is proper in the Northern District of California under 28 U.S.C. §§ 1391(b) 
and 1400(b) because, upon information and belief, acts and transactions constituting at least a 
subset of the violations alleged herein occurred in part in this Judicial District and because 
Defendant TiVo is found and transacts business in this Judicial District. Venue is also proper in 
this Judicial District under 28 U.S.C. § 1391(c) because Defendant TiVo is subject to personal 
jurisdiction in this District. 
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ASYMMETRIC DATA COMMUNICATIONS 
SYSTEM 

RELATED APPLICATIONS 

This application is a continuation of Ser. No. 08/447,537, 
filed May 24, 1995, now abandoned. 

HELD OF THE INVENTION 

The present invention relates in general to the field of data 
communications, and in particular, to the fields of television 
and telecommunications. 

BACKGROUND OF THE INVENTION 

Originally, television programming was provided solely 
by over-the-air broadcast. The most widely received over- 
the-air transmissions were and continue to be in the very 
high frequency (VHF) band and only to a much more limited 
extent in the ultra high frequency (UHF) band of the RF 
spectrum. In recent decades, however, the delivery of tele- 
vision programming into the home increasingly has been 
delivered via CATV (cable) service. CATV transmission 
offered considerably higher bandwidth than was available 
over-the-air, while the quality of its transmission — for those 
equipped with the necessary coaxial cable for receiving the 
analog signal, and the hardware required for descrambling 
it — has been generally better than analog airwave 
transmission, which is subject to a variety of forms of signal 
interference. 

The high bandwidth and transmitted signal quality of 
CATV transmission relative to over-the-air broadcasting has 
led to CATV being a dominant force in the market for 
multiple channel programming. That CATV coaxial delivery 
systems in principle provide sufficient bandwidth to permit 
two way communication with subscribers has fueled specu- 
lation that CATV may provide an early venue for the 
provision of interactive television services. CATV service, 
however, is inherently limited by the extent of its geographic 
penetration. CATV service is simply unavailable in locations 
that cable providers have chosen not to serve. Even where 
CATV service is available, installation of the coaxial cable 
is disruptive as well as expensive. 

The provision of interactive programming content has 
become a major goal of the converging television, 
entertainment, programming, telecommunications, on line 
and computing industries. Telecommunications companies, 
for example, have invested significant resources in devel- 
oping "video dialtone," in which programming services 
would be provided by way of the telephone system. 
Although this approach shows enormous potential and the 
ability to revolutionize both the telecommunications and 
television industries, it presents certain non -trivial techno- 
logical and economic problems. The provision of video 
dialtone services to the borne may turn on the installation of 
optical fiber and/or coaxial cable in place of existing twisted 
pair telephone connections, which presents a highly expen- 
sive and time consuming proposition that is not expected to 
be implemented for some time. 

Aside from efforts to move to what has become known as 
high-definition television (HDTV), and to provide such 
HDTV services over the air, comparatively little attention 
has been paid recently to enhancing television programming 
services that are delivered over the airwaves. A possible 
reason for the comparative lack of effort may be that the 
perceived need to support interactivity would seem to mili- 
tate against a video delivery system that uses as its transport 
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medium one that apparently lacks a return path. The avail- 
able choices for delivery of television programming, 
meanwhile, have continued to grow into such areas as 
"wireless cable" and direct broadcast satellite, (ending to 
5 draw attention even further away from over-the-air broad- 
casting. 

Another factor barring or at least complicating any 
attempt to provide enhanced television service over-the-air 
is imposed by existing federal communications regulations, 

30 set forth in Title 47 of the United States Code of Federal 
Regulations. These regulations establish a framework for the 
delivery of programming over-the-air that is as rigid as it is 
highly detailed, and that, short of legislation, is subject to 
modification only by the Federal Communications 
Commission, and then only within the mechanism provided 

35 by the Administrative Procedures Act, 5 U.S.C. §§551-559, 
§§701-706, §1305, §3105, §3344, §5372, §7521. 

Still another obstacle to the provision of an alternative 
means for providing programming services on a large scale, 
such as by over-the-air broadcast, has to do with equipping 

20 intended recipients of the programming services with the 
means to receive and view the programming. Aside from the 
direct expense associated with providing a new device, 
viewers may harbor concerns about the compatibility of a 
new in-home device with any existing premises equipment, 

25 in which a viewer may have made a sizable investment. 
Even if a device were to be provided gratis by a service 
provider, for example, subscribers may be somewhat reluc- 
tant to commit to a particular system if it were not compat- 
ible with existing delivery systems purely for reasons having 

30 to do with such things as clutter and the consumption of 
available space . Nevertheless, the apparent demand not only 
for traditional television programming, but also for such 
services as home shopping, video games, data services such 
as electronic catalogs, stock market quotations, sports 

35 scores, and electronic newspapers, as well as interactive 
services and video on demand (VoD) or near video on 
demand (NVoD) continues to grow. This consumer demand, 
coupled with an increased demand by marketing organiza- 
tions for demographic and consumer preference information 

40 for use in their characterizing and targeting the increasingly 
segmented consumer populace faced with a growing number 
of viewing alternatives makes clear that any alternative 
means for delivering programming must have a return path 
for enabling viewer interaction. 

45 SUMMARY OF THE INVENTION 

The system, method and device according to the present 
invention solves the problems described above by providing 
an asymmetric data communications system (ADCS) 

50 capable of furnishing an alternative to conventional over- 
the-air and CATV television transmission, and that is also 
capable of providing functionality not furnished by either of 
those delivery systems. The system according to the present 
invention provides an alternative means for the delivery of 

55 video and audio entertainment programming, as well as a 
variety of data services, such as electronic catalogs, stock 
market quotations, sports scores, electronic newspapers, and 
will be able to carry services that have not yet been con- 
ceptualized. The ADCS system of the present invention at 

60 the same time provides a return path capable of supporting 
viewer interactivity, enabling the viewer to request transac- 
tions and orders for services that require authorization, to 
engage in interactive participation in programming distrib- 
uted on a programming channel and other forms of 

65 interaction, as well as providing a data path and a mecha- 
nism for gathering demographic information from subscrib- 
ers. 
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A first aspect of the system according to the present of an over-the-air radio frequency (RF) point-to -multipoint 

invention makes available previously unusable over-the-air broadcast and receiving system. 

broadcasting spectrum. Briefly, and as described at length It is a f^er object of the present invention to provide an 

below, the system according to the present invention alternalive t0 conventional wired cable television that 

digitizes compresses and modulates signals for transmission 5 mdudes & fa b of which US£r transactionS) 

in the UHF spectrum band that is currently assigned to Qrd dem * J ^ il)formation may be xnt or 

television broadcasters, the signal compression using pres- ™ * j * u -i. • a ■ 

.1 -1 i_i 4 « • . l • - jt i_, 4- 4i_ collected from a subscriber premises device, 

ently available techniques to achieve eight or more times the F 

capacity using conventional techniques as can now be It is yet another object of the present invention to provide 
carried in that band. The ADCS system according to the the return path in the form of a wired point-to-point 
present invention thereby provides point-to-multipoint mul- configuration, such as a configuration using switched 
tichannel broadcast services over-the-air on a scale previ- (analog or digital) telephone technology, that in the context 
ously available only using cable, and does so with high of a digital UHF point-to- multipoint broadcast system pro- 
quality transmission and reception, and without interfering vides an asymmetrical data communications system, 
with existing channels broadcasting under the NTSC ^ It is another object of the present invention to provide an 
(National Television System Committee), PAL (Phase Alter- ADCS having a program subsystem capable of aggregating 
nation Line), SECAM (Sequential Couleur A Memoire), or a variety of heterogeneous programming, digitizing and 
other color television transmission standard. In addition, a compressing these signals for UHF broadcast, 
program subsystem of the present invention aggregates Another object of the present invention is to provide an 
heterogenous programming from a number of content pro- 2Q having a retum path facility accessed by subscribers 
viders for digital UHF transmission, as well as VoD and over a public telecommunications network for capturing and 
NVoD, both services being provided only upon completion fulfilling program requests and other transactions and also 
of an authorization function. for collecting subscriber demographics information. 

The system according to the present invention provides an h ^ a|m a Qbject of (be m ir]vemion to 

alternative to CATV for those who wish to subscribe to ^ provide an mte Uig e nt control box to act as an electronic gate 

services that have previous y been considered the exclusive k at the subscriber ' s presenC e in the form of a matrix 

province of CATV Notably, subscribers dissatisfied with swilch ^ rf idin an ^ ble of receiv . 

CATV services or who simply are not served by CATV will . and decoding a digital RF transmission in the UHF band, 

be able to gain access to a large number of channels and at and communicating briber messages to the ADCS. 
a considerably lesser expense, since the below-described 3Q 

system will enable program providers to offer the point-to- BRIEF DESCRIPTION OF THE DRAWINGS 
multipoint broadcasting at a cost lower than that associated 

with that of the installed cable system base. Subscribers will FIG. 1 is a schematic view of an embodiment of an 

be able to receive and participate in interactive television asymmetrical data communications system according to the 

without the need for a cable connection. Such subscribers 35 present invention. 

will simply need a suitable device, referred to herein as an FIG. 2 is a component block diagram of the components 

intelligent control box (ICB) and described in detail below. of an embodiment of an asymmetrical data communications 

According to the present invention, the ICB is adapted not system according to the present invention, showing data 

only to receive, decompress, decode and transmit for display paths between the components. 

the received digitized UHF signals, but also to provide a 4D FIG. 3 is a block diagram showing the architecture and 

terminal capable of establishing a retum path to the broad- functions of the major components of an embodiment of an 

caster via the public switched telephone network (PSTN) asymmetrical data communications system according to the 

(e.g., POTS, ISDN, ADSL, B-ISDN) or a suitable wireless present invention. 

alternative. The ICB serves as an electronic gatekeeper, FIG. 4 is a component block diagram of a program 

providing matnx switch functionality to interface between 45 subs lem of an embodiment of an asymmetrical data com- 

the ADCS and a consumer television, computer or any mumcations svstem according to the present invention, 

suitable monitor or terminal device. As further described _ . 

below, the ICB can include transmission decoding FIG. 5 is a block diagram showing the signal processing 

functionality, data storage, switching and authorization ste u ps of mulU ?}* Vlde0 sources ^ om ^ m the P ro S ram 

functions. The ICB can also include a capability for switch- 50 s f s ? stem and/or ^mission subsystem of an embodiment 

ing between a variety of non-ADCS inbound or downstream of a u n ^metrical data communications system according 

sources, including conventional "over-the-air" television, 10 ?*. P res< f »™tiOD, ™* indicating alternative suitable 

CATV, MMDS (multipoint microwave distribution system, techniques for performing each step, 

or "wireless cable"), DBS ("direct broadcast satellite"), FIG. 6 is a block and partially schematic diagram showing 

LMDS ("local multipoint distribution system," provided, 55 transmission subsystem of an embodiment of an asym- 

e.g., by Cellular Vision), VCRs, computer/video games, and metrical data communications system according to the 

mass storage devices. present invention, 

A final part of an ADCS system according to the present FIG. 7 is a component block diagram of an ICB of an 

invention is a return path facility which, along with ICBs to embodiment of an asymmetrical data communications sys- 

which it is linked by the PSTN or wireless alternative, 50 tem according to the present invention, 

constitutes the return path subsystem of the ADCS system FIG. 8 is a component block diagram of a return path 

according to the present invention. facility of an embodiment of an asymmetrical data commu- 

Accordingly, it is an object of the present invention to nications system according to the present invention, 

provide an alternative to conventional wired cable television FIG. 9 is a logic flow diagram for a representative 

(CATV). 65 operation of the ICB and retum path facility of an asym- 

It is another object of the present invention to provide this metrical data communications system according to the 

alternative to conventional wired cable television in the form present invention. 
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DETAILED DESCRIPTION OF THE 
INVENTION 

The system and components of the system according to 
the present invention will be described with reference to the 
accompanying figures, and in an order that reflects the 
delivery of services to consumers. A high-level view of an 
embodiment of the system according to the present inven- 
tion is provided in FIG. 1. As shown, a program subsystem 
10 is equipped to receive content from various sources, 
including: non-local content providers 12 via satellite or any 
other suitable means or transmission path (including optical 
fiber, for example); from local TV programming entities 14 
via microwave, optical fiber, cable, or other suitable trans- 
mission, paths; or over any suitable path from any other 
source (not shown). The received content may include 
conventional channel television broadcasts, home shopping, 
data services, electronic catalogs stock market quotations, 
sports scores, electronic newspapers and other content, 
whether or not presently available. Video-on-demand (VoD) 
or near video-on-demand (NVoD) may also be received by 
any known means and provided by conventional video 
servers, as described at greater length below. 

Program subsystem 10 collects and processes the signals 
from these various sources and, after processing the signals, 
provides the programming, data and any other received 
content in an appropriate form and over a suitable data link 
18 to a transmitter subsystem or site 20, 

Transmitter subsystem 20 includes transmission 
equipment, described in detail below, for generating a signal 
having sufficient effective radiated power (ERP) and signal- 
to-noise ratio (SNR) to reach a set of intended subscribers 30 
with acceptably high quality reception. In the preferred 
embodiment of the present invention, program subsystem 10 
and transmitter subsystem 20 transmit this combined content 
in digital form and in the ultra high frequency (UHF) band 
of the RF spectrum (407-806 MHz). 

Subscribers 30 each are equipped at their premises with 
appropriate receiving and processing equipment (not shown 
in this view, but described in detail below). Using this 
equipment, subscribers 30 can select from among the variety 
of content carried by the signals) transmitted by the equip- 
ment at transmission site 20, as well as from among the full 
array of other programming sources as to which the pre- 
mises equipment acts as an electronic gateway. Communi- 
cations from subscribers 30 can include requests for VoD, 
NVoD, or other interactive or non-interactive program 
service, and can also include marketing information regard- 
ing subscriber 30. Messages from (or about) subscriber 30 
are transmitted via switched telephone technology, i.e., the 
public switched telephone network (PSTN) lines 40 (or a 
suitable wireless alternative, not shown) and via switching 
and other service sites maintained and operated by a local 
telephone service provider 45, to a return path facility 50 
(which may also be operated by a telephone service 
provider, BellSouth Corp., for example). 

Return path facility 50 may also undertake transactions 
with other service providers (collectively identified by ref- 
erence numeral 48). Return path facility 50 also receives 
communications from other subscribers (via lines 49 A, 49B, 
. . , , 49N), and performs a variety of functions including the 
control of sessions with subscribers 30 and conducting 
administrative functions, both of which will be discussed in 
detail below. Finally, return path facility 50 communicates 
authorization requests to program subsystem 10 via a high 
capacity data link 52, such as a broadband circuit or other 
high capacity link. 
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The overall architecture of the ADCS according to the 
present invention is shown in somewhat greater detail and in 
block diagram form in FIG. 2. At premises 32 of subscriber 
30, for example, an antenna 131 is installed for receiving a 
5 broadcast signal from transmission subsystem 20. The 
received signal is routed to an intelligent control box 
("ICB") 130, which is also configured to receive input from 
all other available sources 100. ICB 130 is equipped to 
receive input from subscriber 30 and to transmit an appro- 

10 priate signal, such as an NTSC, PAL, SECAM or other 
analog standard television signal, to television 34. ICB 130 
may also be equipped to route signals to one or more 
additional televisions or other terminal devices, such as 
personal computers ("PCs")(not shown). ICB 130 may be 

15 coupled to a network interface unit ("NIU") 36 in order to 
communicate over a network. Alternatively, the functional- 
ity of NIU 36 could as easily be implemented by a device 
resident within ICB 130. 

Also shown in FIG. 2 as connecting subscriber premises 

20 32 with return path facility 50 by way of the PSTN 40 and 
telephone service provider facilities 45 is an optional path 42 
via which return path facility 50 can send messages to ICB 
130. Return path facility 50 receives via telephone service 
provider 45 messages not only from subscriber 30, as 

25 shown, but also from any number of subscribers (not shown 
in this view) reached by transmission subsystem 20, pref- 
erably by a high capacity link of sufficient bandwidth to 
simultaneously accommodate messages from a large num- 
ber of subscribers. 

30 I. Program subsystem 

As shown schematically in FIGS. 1 and 2 and functionally 
in FIG. 3, and as shown in still greater detail in FIG. 4, 
program subsystem 10 is equipped with conventional equip- 
ment to receive content via any suitable communications 

35 link from all programming and data sources. Programming 
and data from non-local content providers 12 can be 
received, for instance, via satellite (see FIG. 1) by tuner 23 A, 
while programming from local TV content providers 14 
could be received by tuner 23B from other transmission 

40 media, such as microwave or cable, and also by video tape, 
compact disc ("CD") delivered to the program subsystem. 
Among the variety of sources of content to which program 
subsystem 10 is preferably linked are video and audio 
entertainment programming, data services such as electronic 

45 catalogs, stock market quotations, sports scores and the like, 
electronic newspapers and other services, as well as other 
types of content that are as yet unavailable. 

In addition to equipment for receiving the variety of 
content via various transmission paths, program subsystem 

50 10 includes conventional video server means 28 for provid- 
ing VoD and/or NVoD services, for example. With VoD and 
NVoD, a preselected set of films is delivered simultaneously, 
but out of phase (i.e., staggered) by a predetermined amount 
of time, in order to permit VCR-Iike functionality to sub- 

55 scribers 30, as discussed in greater detail below. For 
example, a selection of the 10 top films at any given time 
may be provided. 

Program subsystem 10 tuners 23 A and 23B and video 
server system 28 are coupled to program subsystem bus 21, 

60 on which the received data may be read and managed by one 
or more processors 24. Processor 24 can be implemented by 
a conventional device or set of devices having sufficient 
processing power to manage the receipt and suitable signal 
processing of content, as described, and also to manage the 

65 video server system 28. In carrying out its tasks, processor 
24, by way of program subsystem bus 21, can read system 
software and other data from static memory 25, and can 
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INTRADISTRICT ASSIGNMENT 

8. Because this action concerns claims for patent infringement, this case is not 
subject to assignment to a particular location or division of the Court pursuant to Local Rule 3- 
2(c). 

COUNT ONE: INFRINGEMENT OF U.S. PATENT NO. 5,809,492 

9. AT&T incorporates by reference Paragraphs 1 through 8, as if fully set forth 

herein. 

10. United States Patent No. 5,809,492, entitled "Apparatus and Method for Defining 
Rules for Personal Agents" (hereinafter, the '"492 patent"), duly and legally issued on 
September 15, 1998 after a full and fair examination. AT&T Intellectual Property II, L.P. is the 
assignee of all rights, title, and interest in the '492 patent, including the right to sue and recover 
for all past infringement. A true copy of the '492 patent is attached as Exhibit A. 

11. As an example, and not to be limited to only a single infringing product, TiVo has 
developed, has tested, promotes, markets, and sells DVR units that can execute software program 
modules for managing the recording and deletion of programs, such as "Season Pass Manager." 
Such products (or the use or operation of such products) fall within the scope of one or more 
claims of the e 492 patent. 

12. TiVo has infringed and continues to infringe the '492 patent, by, among other 
acts, making, using, offering for sale, selling, and/or importing within this Judicial District and 
elsewhere in the United States, without license or authority by AT&T, products covered by one 
or more claims of the '492 patent, including, but not limited to, DVR units that can execute 
software program modules for managing the recording and deletion of programs. 

13. As a consequence of TiVo's infringement, AT&T is entitled to recover damages 
adequate to compensate it for the infringement complained of herein, but in no event less than a 
reasonable royalty. 

14. TiVo has caused and will continue to cause AT&T substantial damage and 
irreparable injury by virtue of its past and continuing infringement of the '492 patent TiVo will 
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store and retrieve data in dynamic memory 26 and mass 
storage device or devices 27, all of which can be imple- 
mented with conventional technology. 

Additional input to program subsystem 10 originates at 
return path facility 50 and is provided over link 52, which 5 
can be a broadband link or other link suitable for carrying a 
large volume of data. The data provided to program sub- 
system 10 by return path facility 50 includes, but is not 
limited to, requests for authorization for requested 
programming, such as pay-per-view, VoD, or NVoD, 
According to known techniques, the processor or processors w 
of program subsystem 10 includes functionality for receiv- 
ing requests for pre -stored authorization codes correspond- 
ing to the subscribers and for incorporating one or more 
codes into the broadcast signal in order to enable a request- 
ing subscriber to receive an encrypted program, as will be 15 
further described below. Input received over link 52, in the 
form of authorization requests or messages, is demodulated 
or otherwise processed as necessary by I/O device 22A, and 
is provided on program subsystem bus 21 for processing, 
management and storage by processor 24. Messages can be 
sent by program subsystem 10 via I/O device 22A back to 
return path facility 50 as necessary, such as to acknowledge 
an authorization request or to provide information for use in 
managing the ADCS. 

Referring again to FIG. 2, the primary functionality of the 
program subsystem 10 is shown. Incoming channel service, 25 
\faD or NVoD sources, and all other input content are 
received according to known methods. The received pro- 
gramming and content are then processed to produce a 
signal that can be provided via link 18 to transmitter 
subsystem 20 in a form suitable for physical transmission. 30 
The processing performed by program subsystem 10 applies 
known methods to achieve a maximum transmission rate 
and a minimal probability of transmission errors, while 
keeping to a minimum the amount of transmitter power 
required, and the RF bandwidth required. 35 

The available bandwidth for transmission is likely to be 
driven in part by the regulatory environment, as well as by 
the availability (or lack of availability) of suitable UHF 
channels in a given market. Under the present regulatory 
framework, channels are denned in 6 MHz RF bands. The 
UHF spectrum, defined as the 470-806 MHz band, is 40 
divided into 56 such 6 MHz channels, which are identified 
by convention as numbers 14 to 69. The UHF band has been 
used to provide television service for decades, thus trans- 
mission equipment is available from a variety of vendors. 

Propagation of signals in the UHF spectrum is generally 45 
line-of-sight, and thus limited by obstructions in the path 
between the transmitter and a receiver, such as mountains 
and the curvature of the earth. However, the presence of 
these obstructions can lead to the diffraction of UHF signals 
and thus to a certain degree of circumvention of the 50 
obstacles. Signals in the UHF spectrum also reflect off 
certain obstructions, which tends to divide the energy in the 
signals into fractions that propagate to a given receiver over 
more than one path. Such multipath propagation can lead to 
fractions of a UHF signal arriving at a receiver at slightly 55 
different times, causing a phenomenon known as "ghosting," 
in which one or more phantom images trail a primary image 
on the television screen. Ghosting can be addressed through 
channel equalization techniques. 

Transmission of a large number of component signals iD 
a single-to -multipoint UHF transmission poses a number of 60 
technical and regulatory problems. Present FCC allocation 
rules, for example, grant RF spectrum rights to one use or 
user exclusive of others and in such a manner as to be 
protected from interference. Co-channel interference is 
addressed by enforcing a mileage separation of broadcast 65 
facilities to hold the desired to undesired signal ratio (D/U) 
to a predetermined level. 



Digital transmission is less susceptible to co-channel 
interference. Nevertheless, it is expected that existing NTSC 
(or PAL, SECAM or other analog television standard) 
channels will be protected to the extent presently required 
for a number of years. 

In addition to co-channel protection, UHF signals are 
protected by rules designed to limit interference between 
adjacent channels. These rules, known as "UHF taboos," 
constrain the D/U between immediately adjacent channel 
signals to be -6 dB or greater, require separation of trans- 
mitter sites by a predetermined distance to address interfer- 
ence introduced by local oscillator radiation, require sepa- 
ration of image frequencies associated with the visual and 
sound carriers, and preclude use of the second through fifth 
adjacent channels to combat intermodulation distortion. The 
UHF taboos are set forth in 47 C.F.R. § 73.699 (Table 
IlXincorporated herein by reference). 

In order to support the delivery of the maximum number 
of programming channels, as well as a desirable number of 
films available for VoD or NVoD delivery, and permitting 
this service to be as close as possible to "VCR 
functionality," it is desirable to substantially reduce the 
bandwidth necessary for the delivery of adequate service. 
Several approaches may be used. 

In one embodiment of the system and method according 
to the present invention, the resolution of the programming 
is purposely selected to be equivalent to that available from 
video home system (VHS) video tapes or other publicly 
acceptable medium having resolution lower than is associ- 
ated with conventionally broadcast television signals. The 
resolution of VHS-quahty video is approximately 256 by 
240 pixels. Since video consumers appear comfortable with 
this resolution, transmission by the ADCS program and 
transmission subsystems would appear to be efficient yet 
unobjectionable at that degree of resolution. 

In another embodiment, a data compression scheme is 
used, for example, MPEG2 compression (Moving Pictures 
Expert Group standard 2, an international video and audio 
compression and transmission standard described in ISO/ 
IEC CD 13818-1, the contents of which are incorporated by 
reference herein) or any other suitable standard, format, 
protocol, data structure, sequence or organization scheme 
for reducing the bandwidth required for transmission. 
Assuming video stream(s) encoded at 3 Mbps, the number 
of such digital video streams available in a 6 MHz channel 
can be computed according to the following relation: 

where 
R=bit rate; 

B=channel bandwidth; 

N=signalling (or quantizing) level of modulation; 
U=payload useability (lo take into account forward error 
correction); 
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0.75 
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The foregoing relation applies to any video encoding/ 
compression scheme and the results in the table apply for 
any video streams encoded at 3 Mbps per video stream. 
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The quantizing level and the efficiency with which the 
video streams are encoded are functions of available tech- 
nology. In general, programming that will be provided as 
channel service is digitized, suitably compressed, encoded 
and modulated according to known techniques, some alter- s 
natives for which are shown in FIG. 5. To begin with, the 
multiple video sources received by program subsystem 10 
may each be source coded 112 (or "compressed") if possible 
in order to reduce the bandwidth needed for transmitting 
them. Suitable source coding techniques that may be used 10 
include character coding, sampling, quantization, pulse code 
modulation (PCM), differential PCM (DPCM), block 
coding, and synthesis/analysis coding. Another class of 
source coding or compression techniques, known as redun- 
dancy reducing coding, reduces the volume of data required 15 
to transmit a signal by eliminating redundancy in the signal, 
as well as information that would rejected rather than 
processed by a viewer because of psychobiological limita- 
tions on human perception. For example, a typical scene in 
a video contains much information that does not change 20 
from frame to frame, Transmitting only the changes in the 
scene permits a significant reduction in the volume of data 
transmission without any loss of information to the viewer. 
Another form of source coding or compression takes advan- 
tage of the psychobiological phenomenon that the human 25 
eye is less capable of resolving colored images than black 
and white images, permitting a commensurate reduction in 
the amount of data to be transmitted without a delectable 
loss of resolution. 

Well-known compression techniques may be used. For 30 
example, but without limitation, the MPEG-1 (Motion Pic- 
ture Experts Group of the International Standards organiza- 
tion (ISO)), or MPEG -2 standard would offer the possibility 
of "scalable" resolution, and which is currently being imple- 
mented in the form of a commercially available integrated 35 
circuit chip. However, any other suitable compression tech- 
nique could also be used. Using MPEG-1 merely as an 
example, a compression ratio on the order of 100:1 can be 
achieved. Accounting for imperfections in ttansmission, the 
effective bandwidth required for a video stream can accord- 40 
ingly be reduced to the order of 0.08 MHz, implying a 
theoretical upper limit of 72 VHS-quality video streams per 
6 MHz channel according to the current spectrum allocation. 

Suitable transmission efficiencies may be achieved with 
currently available channel coding methods, such as 45 
16-QAM (quadrature amplitude modulation), 4-VSB 
(vestigial sideband), 1-PSK (phase-shift keying) or OFDM 
(orthogonal frequency division multiplexing). The second 
processing step for the incoming video streams is channel 
coding 114, which can be used to reduce required bandwidth so 
and the presence of transmission errors. Channel coding 
includes waveform coding, such as M-ary signalling, and 
antipodal, orthogonal, biortbogonal and transorthogonal 
coding. Channel coding also can include structured 
sequence coding, for example using block codes or convo- 55 
lutional codes. Both block codes and convolutional codes 
are directed to minimizing- the bit error ratio (BER) via 
forward error correction (FEC). BER is one of the most 
important quality factors observed in evaluating digital 
transmission systems. FEC techniques are intended to 60 
reduce residual BER by several orders of magnitude and 
also to increase system gain by encoding the bit stream prior 
to modulation. The coding involves adding extra bits to the 
bit stream according to specific rules; thus, they intention- 
ally add a certain amount of redundancy. Using the forego- 65 
ing techniques, reliability can be traded off against efficiency 
to achieve suitable system performance. 
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After the incoming signal has been suitably source coded 
and channel coded, the compressed multiple video sources 
may be further processed using spreading or spread spec- 
trum techniques 116, such as direct sequencing (DS), fre- 
quency hopping (FH), time hopping (TH) and hybrids of 
these techniques. Spread spectrum techniques improve a 
signal's interference resistance and thus bandwidth effi- 
ciency characteristics by distributing the transmitted power 
over a bandwidth sufficiently wide to ensure that the power 
per unit bandwidth is kept very small. 

Spread spectrum signals are difficult for a casual listener 
to intercept, but true security requires encryption. In order to 
protect them against unintended reception, the multiple 
video source signals are encrypted 118 according to known 
methods, such as block and data stream encryption tech- 
niques. 

The digital multiple video source signals, having been 
compressed, channel coded and spread, are also synchro- 
nized 120 and modulated 122 according to known methods, 
some of which methods are listed, without limitation, in 
FIG. 5. 

Finally, the compressed, channel coded, spread, 
encrypted, synchronized and modulated multiple video 
source signal is multiplexed 124 according to known tech- 
niques listed at reference numeral 124 of FIG. 5, including, 
without limitation, frequency division multiplexing, time 
division multiplexing, code division multiplexing, space 
division multiplexing and polarization division multiplex- 
ing. The fully processed, modulated and multiplexed signal 
is provided, as shown in FIGS, 1 and 2, over link 18 to 
transmitting site 20. 

The techniques referred to in the schematic of FIG. 5 and 
the accompanying description, are illustrative but not 
exhaustive of the techniques that could be used to practice 
the present invention. Other known techniques may also be 
used, and their choice, as well as chosen parameters, may 
depend not only on designer preferences but on design 
constraints imposed by the setting of the transmitter, the 
chosen equipment, and other factors. Moreover, the process- 
ing associated with these techniques could be performed in 
program subsystem 10, as described above, but could alter- 
natively be done, at least in part, at transmission subsystem 
20 as shown in FIG. 6 and described in the text accompa- 
nying that figure. 

The VoD or N\faD functionality of the program sub- 
system may also be implemented according to known meth- 
ods. VoD service is widely understood to mean that a desired 
video program can be viewed within 5 minutes after it has 
been selected. Preferably, a user can exercise virtual control 
over the transmission by pausing, rewinding, fast forwarding 
or other function as one would do with a conventional video 
cassette player. In order to achieve this functionality, for 
example with a two-hour long film, it would be necessary for 
twenty four simultaneous video streams to be transmitted, 
one beginning anew every five minutes. Fast forwarding, 
rewinding and pausing are thus achieved by tuning to the 
appropriate time-shifted channel. The program subsystem 
10 would receive a request for authorization from a sub- 
scriber 30, as further described in connection with FIG. 9, 
and would transmit this authorization, for example in a 
vertical blanking interval of a preselected channel. The 
authorization would be received by the ICB 130 of the 
requesting subscriber 30 and thereby enable receipt and 
viewing of the appropriately time-shifted channel. Providing 
10 film offerings of two-hour duration with 5 minute VoD 
functionality would require 240 simultaneous video streams. 
Provided that 8 video streams can be reliably transmitted in 
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a single 6 MHz RF channel, 30 RF channels will be required having a suitable height above the ground, while taking into 
for this VoD function, the availability of which channels will account the relative altitude of its base. For example, trans- 
depend on the market, as well as the state of applicable mission tower 28 could be 1000 feet high or more, if 
federal regulations. To facilitate the provision of VoD, required. Each of the waveguide transmission lines 27AB, 
relaxing the delay from 5 to 10 minutes, thus being closer to s 27C and 27N is coupled to a corresponding antenna 29AB, 
NVoD, would reduce by half the required total bandwidth to 2 9C and 29N, respectively. These antennas are also sup- 
TT ~ cha ° n ? ls ' ported by transmission tower 28, which must be sufficiently 
II. Transmission Subsystem • „ t • ™. * stron S t0 **«r them along with the waveguide transmission 

Ju^T° n ^rT 20 ? Sh H W w D d&t f ™ F V' 27AB, 27C and 27N, and should accordingly be 

Although the multiplexing and modulation of signals has „r, tJ -.. .i L 

been described above in connection with program subsystem 10 w " h s ^ en *™g* according to known metb- 

10, that functionality, or some of it, could alternatively be P^rably, at least three antennas shou d be used in 

provided at transmission subsystem 20, as shown in FIG. 6. order 10 s ^PP ort transmission across the entire UHFband. As 

If the functionality were provided in the program subsystem Wlth transmission lines, antenna efficiencies are frequency- 

10, it could accordingly be excluded from transmission dependent. The height of transmission tower 28 should 

subsystem 20. As shown herein, however, transmission line 15 ensure sufficient vertical aperture of antennas 29AB, 29C 

18, which may include a plurality of separate lines, delivers and 29N - As an alternative to a large single structure, several 

the entirety of the programming content from program smaller supporting structures could be used (not shown), 

subsystem 10 to transmission subsystem 20. Subsets of the The transmission subsystem 20 can be expected to generate 

programming content may be input to multiplexers 21A, a high level of non-ionizing radiation, which, depending 

21B, 21C, , . . , 21N, where they are multiplexed according 20 upon the height at which the antenna(s) are actually 

to known methods, as.described in connection with box 124 mounted, may require that its site be located most preferably 

of FIG. 5. The multiplexed signals output from multiplexers at an appreciable physical distance from human populations. 

21 A, 21B, 21 C, . . . , 21N are then digitally modulated at As described above, known components can be used in 

22 A, 22B, 22C, . . . , 22N, respectively, according to transmission subsystem 20, preferably of a type suitable at 

conventional modulation techniques. Each multiplexed, 25 least for use with high definition television (HDTV), 

modulated signal is then upconverted to RF frequency by a III. Return Path Subsystem 

corresponding upconverter 23A, 23B, . . . , 23N, which may Broadcasts by the transmission subsystem 20 are received 

be implemented by conventional equipment. Output from by subscribers who are within the broadcast pattern of the 

upconverters 23A-23N is then amplified by power ampli- transmission subsystem 20 and who at their premises 32 

fiers 24A, 24B, 24C, . . . , 24N, respectively. Each power 30 have a proper receiving device. According to the present 

amplifier 24A— 24N, which may be conventional equipment, invention, the receiving device is a component of a piece of 

should be capable of generating a peak output sufficient for equipment having a number of functions, and which is 

appropriate radiated RF energy to allow proper reception of referred to as an ICB (intelligent control box) 130. 

equivalent NTSC (or PAL, SECAM or other analog televi- Along with the return path facility 50 to which it is linked 

sion standard) transmission. Output from each power ampli- 35 by a telecommunications system, such as PSTN lines 40 (or 

fier 24A-24N is filtered by one or more filters 25A, 2SB, a suitable wireless alternative, not shown) and switching and 

25C, . . . , 25N, each filter being of a conventionally other facilities operated and maintained by public telephone 

available sort and sufficiently sized to accommodate the services provider 45, the ICB 130 constitutes a portion of the 

power of the output of the corresponding amplifier return path subsystem 80 of the described embodiment of 

24A-24N, to reduce spurious signals to acceptable levels. In 40 the system according to the present invention. The use of the 

an alternative embodiment, the number of sets of transmit- PSTN lines 40 between the portions of the return path 

ting equipment could be reduced by further multiplexing a subsystem 80 takes advantage of the realization that the 

set of signals prior to modulation, upconversion and ampli- timing and information content of communications by 

fixation. humans differ enormously from those of the broadcast path, 

The output signals from the filters 25A-25N are applied 45 perhaps on the order of 10 9 . Information sent upstream by a 

to combiners, which may be conventionally available equip- subscriber 30, moreover, would tend to be sporadic rather 

ment. For example, output from filters 25A and 25B are than continuous. The second portion of the return path, 

combined by combiner 26AB, while output from filter 25C return path facility 50, implements two types of functional- 

and perhaps other filters are fed to combiner 26C, and output ity: switching and accounting system 60 and external trans- 

from filters including filter 25N are input into combiner 26N. 50 action system 70, each of which will be described below. 

The output of each combiner 26 AB, 26C 26N is A. Intelligent Control Box (ICB) 

applied, if necessary, to corresponding transmission lines ICB 130 forms that portion of the return path subsystem 
27 AB, 27C, . . , , 27N, respectively. Since the transmission 80 of the system according to the present invention that 
lines may be required to transmit several high-powered resides at the premises of subscriber 30 and receives the 
signals, conventional coaxial transmission lines may not be 55 digital UHF broadcast from the transmission subsystem 20. 
useable. In such cases, transmission lines are preferably In addition to this role, ICB 130 also provides subscribers 30 
waveguides of large diameter (e.g., 18 inches in diameter). with a variety of additional capabilities and functions. 
Waveguide size is driven by the lowest frequency to be The architecture for an embodiment of ICB 130 according 
carried, while the highest frequency that can be carried by to the present invention is shown in FIG. 7. ICB 130 acts as 
the same waveguide is limited by the transmission 60 a matrix switch (i.e., an electronic gatekeeper) to provide an 
efficiency, which may be about 10% above the lowest interface between the ADCS, the full variety of other pro- 
channel frequency. Since the UHF television band straddles gramming sources, and the viewer's television monitor, 
470-806 Mhz, as many as five different waveguides would computer, or other peripheral devices. In addition to over- 
be needed to support transmission across that band, although the-air UHF ADCS broadcast, ICB 130 is provided with 
for convenient illustration, three are shown. 65 input ports to receive signals from any number of available 

Portions of waveguide transmission lines 27AB, 27C and sources. ICB 130 can accept input from an antenna 132, 

27N are supported by at least one transmission tower 28 which can carry NTSC signals as well as digitized UHF 
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signals transmitted by transmission subsystem 20. Accord- only to descramble a particular transmission on detection of 

ing to the present invention, ICB 130 can also accept input such code or codes. Secure processor subsystem 172 may 

from any number of non-ADCS inbound program sources, include a non-volatile memory subsystem 174 for storing 

such as from a VCR 133, from a DBS provider 134, from an information necessary for decoding received transmissions, 

MMDS provider 135, from an LMDS provider 136, or from 5 including normal cable program transmissions, pay-per- 

a CATV provider 137. Input from any other available source, view program transmissions and the like, 

including a mass storage or other device, as well as any In order to interface televisions or other viewing devices 

presently existing or future transmission type, may be accepting a baseband input with a decoding device (for 

received by ICB 130, as denoted by the input port identified example, a CATV decoder, not shown), secure processor 

as "other" 138, which may be adapted or retrofitted to 10 subsystem 174 is optionally coupled to EIA-563 standard 

receive an appropriate connector as necessary. baseband interface, the baseband output of which it can 

All program inputs received by ICB 130 are transmitted provide to baseband -equipped televisions or other devices 

to input selector (matrix switch) 170, which can be any over line 1S2B. 

available hardware for switching between a plurality of Turning to the digital signals received by ICB 130, each 

signals, most preferably under the control of a conventional 15 tuner among the set of tuners 162-166, demodulates signals 

or custom processor. Input selector 170 is coupled to system it is tuned to receive in order to reconstruct the desired 

control bus 180 of ICB 130 by way of which it can receive analog signal. The resulting signal from each tuner is 

switching signals from CPU 184 in order to execute the transmitted by a dedicated line (here shown in a bundle of 

selection commands of subscriber 30, as further discussed such lines denoted in FIG. 7 using the notation "/5") to video 

below. 20 decoder 176, a conventionally available device for interpret- 

ICB 130 may include a tuner for each input type. Signals ing an input stream according to a preselected technique 

switched by input selector 170 are each provided to an compatible with the method used for compressing the video 

appropriate tuner. A selected over-air-air NTSC signal signal at the program subsystem 10, for example. Video 

received via antenna 131, for example, can be tuned by decoder 176 thereby recovers the compressed signal to 

analog tuner 161, as can a selected CATV signal received at 25 produce a video signal. An analog channel received for 

port 137. In an alternative embodiment, one or more addi- example by analog tuner 161 and selected by input selector 

tional analog tuners could be provided for simultaneously 170 may be routed via secure subprocessor system 172 

receiving two analog signals, if it is desired to route two such directly to NTSC signal generation module 182. Digital 

signals to different televisions, computers or other devices, signals received by tuners 162-166 may also be provided on 

to provide a picture-in-picture (PIP) display, or to support 30 dedicated lines (shown in bundled form using the notation 

other functionality. <e /5") to system control bus 180, via which it could be 

Signals on input 132, such as the digital UHF signal provided, as one illustrative example, via computer interface 

transmitted by transmission subsystem 20 according to the 196 to a computer or other device. 

present invention are received by ATV tuner 162, which can Analog descrambler 172 and video decoder 176 are both 

be a conventionally available digital tuner and demodulator. 35 coupled to graphics assist module 178. Graphics assist 

DBS input arriving at port 134, if selected and accordingly module 178 can be any conventional graphics processor 

switched by input selector 170, can be received by tuner 163, suitable for adding a desired graphics overlay onto the video 

while MMDS signals entering at port 135 and switched by signals received from the video decoder 176 and/or the 

input selector 170 are received by MMDS tuner 164. analog descrambler 172 in response to instructions imple- 

Similarly, LMDS signals arriving at 136 and switched by 40 mented by software running on CPU 184 and provided over 

input selector 170 can be tuned by LMDS tuner 165. All of system control bus 180. The functionality of graphics assist 

the foregoing tuners may be implemented by any commer- module 178 could alternatively be implemented by CPU 

cially available devices for receiving the respective signals. 184, if it were suitably programmed and capable of sufficient 

Moreover, the fore going- tuners are illustrative rather than throughput. As will be further described below, graphics 

exhaustive; signals requiring tuning that cannot be done by 45 assist module 178 generates a video signal overlaid on the 

way of the foregoing tuning devices, such as signals accord- existing television signal providing, in response to instruc- 

ing to as yet unconceived schemes, can be received by a tions received over system bus 180. For example, a menu of 

suitable associated tuning device or devices represented by viewing options, information regarding the ordering of a 

box 166 with which ICB 130 can be retrofitted as desired. VoD or NVoD video, or any other information regarding 

Subscriber 30 thus does not have to collect, operate and 50 subscriber transactions may be overlaid on the screen, 

maintain a set of devices from various vendors each of Graphics assist module 178 may generate a menu, a button 

which provides only a single purpose solution. image, or a logo or other pattern or symbol, and inject the 

The output from analog tuner 161 (and any additional image into the video stream such that the image appears in 

analog tuners that may optionally be included in ICB 130) a designated portion of the screen. Information used in 

may be transmitted to secure processor subsystem 172. 55 generating the screen images, as described below, may be 

Secure processor subsystem 172 may be any known system available in received signals or may use information stored 

for receiving scrambled or otherwise secured signals over a in the ICB 130, for example, pre-loaded in static memory 

private distribution system. Typically, the secured processor 186. 

subsystem 172, its components, and their functionality are The video stream emerging from analog descrambler 173 

compatible with encryption techniques of the sort employed 60 or video decoder 176, and from graphics assist module 178, 

in program subsystem 10, illustrated, for example, at block is provided to NTSC signal generation module 182. As an 

118 of FIG. 5. Secure processor subsystem 172 includes a alternative to NTSC, signal generation module 182 could 

conventional analog descrambler 173 for descrambling sig- generate signals according to any available and desired 

nals received and forwarded by analog tuner 161. Secure video format. NTSC signal generation module 182 includes 

processor subsystem 172 (or other processor means 65 conventional circuitry for transforming the output of analog 

described below) is programmed to detect one or more descrambler 172, video decoder 176 and graphics assist 

authorization codes included in received transmissions and module 178 into a standard form usable by a conventional 
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television or monitor (not shown in this view). This func- Interaction by the ICB 130 with return path facility 50 via 
tionality could, alternatively, convert input signals to any PSTN lines 40 and telephone service provider 45 is con- 
suitable standard format. As shown in FIG. 7, NTSC signal ducted by CPU 184 through WAN communications proces- 
generation module 182 generates a set of coordinated signals sor and modem 192. WAN communications processor and 
and provides them to one or more terminal devices (not 5 modem 192 can be any conventional device suitable for 
shown) adapted to receive and display television signals, converting messages received via system control bus 180 
including without limitation one or more televisions or into a WAN-compatible protocol, such as IP (internet 
personal computers. Output from NTSC signal generation protocol), and modulating the converted message signals 
module 182 to the one or more terminal devices includes an received from WAN communications processor for trans- 
NTSC video stream 182A on channel 3 and/or 4, a 30 mission over the PSTN lines 40 and via switching and other 
composite/Svideo Out signal 182B (which may also carry facilities maintained and operated by a telephone service 
baseband signals routed through EIA-563 171), and left and provider 45 (as shown in FIGS. 1-3), 
right audio signals 182C. The signal provided by ICB 130 In addition to the primary function of delivering television 
could be any signal deriving in whole or in part from programming to subscriber 30, or management instructions 
received input and be in any desired form. Even more 35 to one or more terminal devices such as televisions or 
generally, CPU 184 can issue instructions to manage computing devices, CPU 184 operating according to soft- 
televisions, computers, or other terminal or peripheral ware residing in static memory 186, for example, and using 
devices without limitation, for example, via computer inter- known methods, implements an authorization function 
face 196, which can be any suitable conventional device, enabling subscribers (and only subscribers) of particular 
coupled to system control bus 180. 20 services, to be able to view programming associated with 
In addition to the previously described components and those services. CPU 184 is also programmed to capture and 
functionality, which have to do with the receipt and provi- send via telecommunication connection 194 to return path 
sion of television signals, possibly with inserted graphics, facility 50 subscriber requests for transactions input via 
ICB 130 includes a number of additional components for remote control system 158, as well as data regarding view- 
implementing other functions. The processing associated 25 ership and other observable events, 
with managing and controlling the functions of the ICB 130 B. Return Path Facility 

is performed by CPU 184. CPU 184 may be any suitable A second portion of the return path subsystem 80 is a 

commercially available processor, and preferably one return path facility 50. Return path facility 50 is shown in 

capable of performing in excess of 30 Mips, such as a FIGS. 1-3 in schematic form, illustrating the functionality of 

POWER PC® or PENTIUM® integrated circuit (IC) chip, 30 that component of the system according to the present 

programmed to process the incoming digitized UHF signal invention. Referring to FIG. 8, return path facility is shown 

according to known methods, as well as selecting and in greater detail. 

processing the remainder of the input provided at ports 134, In brief, return path facility 50 provides an external 

138, 140, 144 and 145, when chosen by subscriber 30. transaction system for facilitating viewing requests, pur- 

Alternatively, CPU 184 could be a custom chip or chip set 35 chases and other transactions by subscriber 30 executed 

for carrying out the same set of functions. In running system from the premises via the ADCS according to the present 

software stored in static memory 186 (which may be an invention, system, and also for facilitating fulfillment of the 

EEPROM, ROM or the like), CPU 184 has access via viewing, purchase, or other request, including taking an 

system control bus 180 to static memory 186 and to dynamic order, processing the order, establishing delivery of the item 

memory 188, which may be conventionally available 40 requested or purchased, conducting billing for the transac- 

memory, preferably with a storage capacity of at least about tion or purchase, and sharing of the proceeds with the seller. 

4-5 MB. CPU 184 also has access via system control bus In addition, return path facility 50 also may capture viewing 

180 to information regarding the current channel, to the and purchase pattern information for subsequent compila- 

graphics assist module 178 regarding graphical display tion by a market analysis center to determine types of 

signals, and to video decoder 176 and input selector 170, as 45 content most valuable to each individual customer. This 

well as to secure processing subsystem 172, and the tuners process facilitates the transmission of targeted advertising 

161-166, in order to assert appropriate command messages messages that can trigger interactions for more information 

to those components. or a transaction. 

Interaction by subscriber 30 with ICB 130 may be by any The return path subsystem 50 is ultimately adaptable from 
suitable means, but is preferably by conventional infrared so an ADCS to a symmetrical data communications system 
(IR) remote control, as in the described embodiment. Input when the PSTN or other non-broadcast return path has 
controller 190 receives signals from subscriber-controlled sufficient available bandwidth to accommodate full video 
remote control input device 158 via an IR receiver and delivery. Return path facility 50 includes conventional pro- 
associated circuitry (not shown). Using input device 158 (or cessing means 54, which can be one or more commercially 
any other suitable input means), subscriber 30 may issue to 55 available processors and which is coupled via a return path 
the ICB 130 instructions to switch between programs, to facility bus 51 to at least one static memory device 55, at 
request VoD or NVoD services via the return path facility 50, least one dynamic memory device 56, and which may also 
to control the delivery of such requested services with VCR be coupled to at least one mass storage device 57. These 
functionality, to purchase items offered for sale on shopping memory devices can all be implemented with commercially 
channels, or to provide any desired input originating with 60 available hardware. 

subscriber 30. Instructions received by input controller 190 Two way communications between return path facility 50 

may be asserted via system control bus 180 as commands to and subscribers, such as illustrative subscriber 30, can be 

input selector 170 and tuners 161-166, to secure processor maintained over a public telephone or other transmission 

subsystem 172, as well as to video decoder 176, and line or lines via I/O device 53, which can be any conven- 

graphics assist module 178. Input controller 190 can also 65 tional device suitable for modulating and demodulating 

send messages to CPU 184 when, for example, subscriber 30 input and output in a manner consistent with the transmis- 

requests an interactive program or other service. sion line. Since the return path subsystem 50 is responsible 
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for receiving request messages, demographics and other indicated the subsystem of the ADCS responsible for per- 

information from all of the subscribers within the signal forming the indicated function. 

range of transmission subsystem 20, the transmission line or Process 200 begins at step 202, at which the ICB 130 
lines are preferably of capacity sufficient to handle this tuner (i.e., the input selector 170) is tuned to regular pro- 
traffic. 5 gramming selected by subscriber 30, which may be a default 

According to functionality described at greater length setting that could be either factory set or determined by 

below, return path subsystem 50 sends messages, such as subscriber 30. Using the IR remote 158, the user may request 

authorization requests, to program subsystem 10 via I/O a viewing session, at 204. CPU 184 of ICB 130 retrieves 

device 58 on return path subsystem bus 51. Optionally, from static memory 186 (or other storage not shown in FIG, 

messages such as demographic, billing or other transaction 10 7) pre-stored code for a viewing selection list and performs 

data can also be sent to other service providers 48 via I/O any necessary processing. Then, via system control bus 180 

device 59 on return path subsystem bus 51. I/O devices 58 and, if necessary, video decoder 176 and graphics assist 178, 

and 59 can be implemented by any conventional equipment the pre-stored selection list code is processed by NTSC 

suitable for this purpose. signal generation module 182 and provided over line 182 A 

As shown in FIG. 3, the functionality of return path 15 to a terminal device, such as television set 34, at step 208. 

subsystem 50 includes two main modules: session control If subscriber 30 expresses no interest in a transaction, 

module 60 and administrative module 70. Processing asso- process 200 simply returns to the beginning, step 202. If 

ciated with both modules is performed by processor 54 subscriber 30 requests a transaction however at 210 (using 

according to software that may be pre-stored in static IR remote 158) and IR controller 190 receives the request, 

memory 55, and utilizing dynamic memory 56 and mass 20 at 212, the CPU 184 of ICB 130 retrieves from static 

storage 57 as necessary. In the illustrated embodiment, but memory 186 a pre-stored request for a personal identifica- 

without limitation, session control module 60 of return path tion number (PIN), which it then causes to be displayed on 

facility 50 is responsible for maintaining an interface with television set 34 as, for example, the character string "Enter 

each ICB 130 that has initiated a session. Requests for PIN." The subscriber 30, having been prompted by the 

programming or other transactions are managed and 25 message, via IR remote 158 enters his or her PIN, which is 

monitored, as are audience observations provided by ICB received by IR controller 190 and stored by CPU 184 in 

130 according to a desired, predetermined approach. Session dynamic memory 188. The CPU 184 of ICB 130 according 

control module 60 also includes the recording of desired to instructions it retrieves from static memory 186 initiates 

aspects of messages and transactions in mass storage device a procedure to verify the PIN, at 224, 

57. Also, transaction requests, demographic or other mar- 30 If the PIN is not verified, CPU 184 causes to be displayed 

keting data, or other received messages are forwarded for on television set 34 the legend "Wrong PIN, Cancel?", or 

processing by administrative module 70. other legend to the same effect, and waits for a response 

Administrative module 70 captures the occurrence of from subscriber 30. If subscriber 30 responds in the 

requested transactions for purposes of billing, recording negative, process 200 returns to step 214, in which the PIN 

viewing patterns, and for fulfilling the requested transaction 35 is again requested (a memory or input error presumably 

by transmitting appropriate requests as necessary over link having been made by subscriber 30). If subscriber 30 

52 to program subsystem 10. Requests for other sorts of responds in the affirmative, process 200 simply returns to 

transactions, such as purchasing offerings on home shopping initial step 202. 

channels or any other transaction may be accounted for and If, on the other hand, the PIN was verified at step 224, 

then provided to the appropriate one of a set of other service 40 then CPU 184 invokes WAN communications processor and 

providers 48 with which the operator of the ADCS has modem 192, CPU 184 dials return path subsystem 50 (which 

established a relationship. Administrative module 70 also might also be referred to as "head end", as it is in FIG. 9). 

gathers customer information regarding customer Processor 54 of return path subsystem 50 establishes a 

viewership, purchasing patterns, and demographic or psy- session with ICB 130 and reads subscriber 30*s request, 

etiological information important for marketing and stores 45 PIN, and other desired subscriber information. Processor 54 

this information as necessary and/or provides it to one or of return path subsystem 50, invoking the administrative 

more of the other service providers 48 according to a module 70, generates billing data associated with this 

predetermined arrangement. Such information gathering request. 

may be done, for example, but without limitation, pursuant For purposes of this logic flow, "headend" is also, for 

to agreements with subscribers permitting the gathering of so convenience, intended to include functionality implemented 

such information, possibly with a reduction in subscription by program subsystem 10. At step 230, the processor 54 of 

rate or some other consideration to the subscriber. Admin- return path subsystem 50 generates and transmits to program 

istrative module 70 of return path subsystem 50 according to subsystem 10 a message that subscriber 30 is authorized for 

a predetermined scheme can also keep track of viewing and a particular selected viewing choice. An authorization code, 

transaction requests for one or more other service providers 55 which may have been pre-stored at return path facility 50 

48, and can use this information to conduct billing on behalf and retrieved for program subsystem 10, or which could 

of those providers 48. alternatively have been pre-stored in program subsystem 10, 

IV. Operation of the ADCS System According to the Present is then included in the transmission by program subsystem 

Invention 10 to transmission subsystem 20 and is thus broadcast, for 

A logic flow diagram for processing associated with a 60 example in the vertical blanking interval of a particular 

representative transaction performed by an embodiment of video stream. The authorization code is inserted into a video 

an ADCS according to the present invention is shown in stream being transmitted in a frequency band to which ICB 

FIG. 9. In particular, subscriber 30 via ICB 130 initiates a 130 is programmed to tune to look for this information, 

request for a particular program requiring authorization, and Accordingly, the authorization code is identified in that band 

the ensuing processing or activity by the ICB 130, the return 65 by the ICB 130 and extracted according to known methods, 

path subsystem 50, program subsystem 10, and transmission at step 232, for use in enabling the decoding of the selected 

subsystem 20 are described. On the top edge of each box is transmission, or tuning to an authorized channel, step 234. 
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CPU 184 of ICR 130 then ensures that the ATV tuner 162 
is tuned to the appropriate band, if necessary, that the input 
selector 170 is switching the transmission from the ATV 
tuner 162 through to the video decoder 176, and that the 
video decoder 176 has the necessary authorization for 5 
descrambling the authorized transmission. At 238 the sub- 
scriber 30 may end the session using IR remote 158, either 
at the end of the program, or for any other reason. If 
subscriber 30 during the course of the transmission does not 
indicate that he or she wishes to terminate the session, CPU lQ 
184 continues to cause the authorized channel to be dis- 
played on television set 34. During this period, other func- 
tionality could be represented, including VCR functionality 
or other subscriber interaction. If, on the other hand, sub- 
scriber 30 does end the session, or if it terminates on its own, 
process 200 in that case returns to initial step 202. 15 

The foregoing describes a preferred embodiment of the 
present invention. Various changes and modifications to 
what is disclosed may be adopted or implemented without 
departing from the scope or spirit of the invention. 

What is claimed is: 20 

1. A system for communicating content to a plurality of 
subscribers, the content carried by signals originating from 
a plurality of content providers, the system for communi- 
cating content comprising: 

a plurality of receivers, each receiver for receiving at least 25 
one of the content-containing signals transmitted by 
one of the plurality of content providers; 

means for digitizing the signals received from the plural- 
ity of content providers, the digitizing means coupled 
to the receiving means for receiving the signals; 30 

means for compressing the digitized signals, the compres- 
sion means coupled to the digitizing means for receiv- 
ing the digitized signals; 

a multiplexer coupled to the compression means for ^ 
multiplexing the digitized signals into at least one 
digital data stream; 

modulating means coupled to the multiplexer for modu- 
lating the at least one multiplexed digital data stream; 

RF upconverter means coupled to the multiplexing means 40 
for channelizing the at least one multiplexed digital 
data stream into the UHF frequency band; 

an amplifier coupled to the RF upconverter means for 
amplifying the at least one UHF multiplexed digital 
data stream; and 45 

an antenna coupled to the amplifier for transmitting the at 
least one amplified UHF multiplexed digital data 
stream; 

whereby an aggregation of programming sources may be 
provided point-to-multipoint to a plurality of subscrib- 50 
ers by way of digital UHF broadcast. 

2. The communications system according to claim 1, 
wherein at least one of the signals from the content providers 
is transmitted via satellite and the at least one receiver 



transmitted optically via optical fiber, and wherein at least 
one of the plurality of receivers includes a receiver adapted 
to receive optical transmissions. 

6. The communications system according to claim 1, 
wherein the received signal comprises video data, and 
wherein the at least one compression means is adapted to 
compress the digitized signal to a resolution of approxi- 
mately 256 by 240 pixels. 

7. A system for communicating with a plurality of 
subscribers, the communication involving content carried by 
signals originating from a plurality of content providers, at 
least one of the plurality of subscribers having access to a 
telecommunications system, the system for communication 
comprising: 

a program subsystem, including: 

a. a plurality of receivers, each receiver for receiving one 
of the plurality content-carrying signals; 

b. processing means coupled to the plurality of receivers 
and adapted for: 

i. digitizing the signals from the plurality of content 
providers; 

ii. inserting desired information into the digitized sig- 
nals; 

iii. compressing the digitized signals; and 

iv. multiplexing the digitized signals into at least one 
data stream; 

c. means for modulating the at least one digital data 
stream, the modulating means coupled to the process- 
ing means; 

d. RF upconverter means coupled to the modulating 
means for channelizing the at least one modulated 
digital data stream into the UHF frequency band; 

e. at least one amplifier coupled to the RF upconverter 
means for amplifying the at least one modulated digital 
signal; 

f. at least one antenna coupled to the at least one amplifier 
for transmitting the at least one amplified data stream; 
and 

a return path subsystem coupled to the program sub- 
system and to the telecommunications system, the 
return path subsystem including processing means 
adapted for receiving over the telecommunications 
system communications from the subscribers and com- 
municating with the program subsystem information to 
be inserted by the program subsystem into the received, 
digitized signals; 

whereby an aggregation of programming sources may be 
provided point-to-multipoint to subscribers by way of 
digital UHF broadcast, subscriber input regarding the 
broadcast can be received, and program transmissions 
may be modified in response to the subscriber input. 

8. A system for communicating with a plurality of 
subscribers, the communication involving content carried by 
signals originating from a plurality of content providers, at 



includes means for receiving signals transmitted via satel- 55 least one of tBe plurality of subscribers having access to a 

telecommunications system, the system for communication 
comprising: 

a. a program subsystem, including: 

i. a plurality of receivers, each receiver for receiving 
one of the plurality content-carrying signals; 

ii. processing means adapted for modifying the 
received signals, the processing means coupled to 
the plurality of receivers; 

b. a transmission subsystem coupled to the program 



lite. 

3. The communications system according to claim 2, 
wherein a second of the plurality of received signals is 
provided via cable, and at least one of the plurality of 
receivers is adapted to receive cable transmissions. 

4. The communications system according to claim 3, 
wherein a third of the plurality of received signals is 
provided via microwave transmission, and wherein at least 
one of the plurality of receivers includes a receiver adapted 
to receive microwave transmissions. 

5. The communications system according to claim 4, 
wherein a fourth of the plurality of received signals is 



subsystem and receiving from the program subsystem 
the received signals, the transmission subsystem 
including: 
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i. means for digitizing the signals from ibe plurality of 
content providers; 

ii. means for compressing the digitized signals, the 
compression means coupled to the digitizing means; 

iii. a multiplexer, for multiplexing the digitized signals 5 
into at least one data stream, the multiplexer coupled 

to the compression means; 

iv. means for modulating the at least one digital data 
stream into the UHF frequency band, coupled to the 
multiplexing means; J0 

v. RF upconverter means coupled to the modulating 
means for channelizing the at least one modulated 
multiplexed digital data stream into the UHF fre- 
quency band; 

vi. at least one amplifier coupled to the RF upconverter 
means for amplifying the at least one modulated 35 
digital data stream; and 

vii. at least one antenna for transmitting the at least one 
amplified, channelized, modulated, digital data 
stream; and 

c. a return path subsystem coupled to the program sub- 20 
system and to the telecommunications system, includ- 
ing processing means adapted for receiving over the 
telecommunications system communications from the 
subscribers; 

whereby an aggregation of programming sources may be 25 
provided point-to-multipoint to subscribers by way of 
digital UHF broadcast and subscriber input regarding 
the broadcast can be taken into account by the com- 
munications system, 

9. The communications system according to claim 8, 30 
wherein the processing means of the return path subsystem 

is further adapted to communicate with the program sub- 
system on receiving a communication from a subscriber, and 
the processing means of the program subsystem is further 
adapted to modify the received signals on receiving a 35 
communication from the return path subsystem, whereby the 
transmission may be modified in response to a subscriber 
request. 

10. The communication system according to claim 9, 
wherein the received signals include a plurality of programs, 40 
the subscriber request relates to of the plurality of programs, 
and the modification of the received signals by the program 
subsystem in response to subscriber requests is the inclusion 

of an authorization code in the transmission, the authoriza- 
tion code corresponding to the subscriber request for a 45 
particular program. 

11. The communications system according to claim 8, 
wherein the program subsystem further comprises a video 
server system, the video server system including at least one 
video server and adapted to play at least one of a preselected SO 
set of videos, the return path processor means being further 
adapted to receive requests for transmission of one of the 
preselected set of videos and to transmit to the program 
subsystem a message regarding authorization for transmis- 
sion to the subscriber of the one preselected video, and the 55 
program subsystem processing means being further adapted 

to include in the transmission an authorization code corre- 
sponding to the subscriber and to the selected video. 

12. The communications system according to claim 8, 



14. The communications system according to claim 12, 
wherein the record corresponding to communications 
received from subscribers contains subscriber preference 
information derived from the subscriber communications. 

15. A system for communicating content with a plurality 
of subscribers, the content originating from a plurality of 
content providers and transmitted by each content provider 
via receivable signals, at least one of the plurality of 
subscribers having access to a telecommunications system, 
the system for communicating content comprising: 

a. a program subsystem, including: 

i. a plurality of receivers, each receiver for receiving 
one of the plurality of signals, each signal from one 
of the plurality of content providers; 

ii. processing means adapted for modifying the 
received signals, the processing means coupled to 
the plurality of receivers; 

b. a transmission subsystem, including: 

i. at least one means for digitizing the signals from the 
plurality of content providers coupled to the receiv- 
ing means; 

ii. at least one means for compressing the digitized 
signals, coupled to the digitizing means; 

iii. at least one multiplexer, for mulitplexing the digi- 
tized signals into at least one data stream, coupled to 
the compression means; 

iv. means for modulating the at least one digital data 
stream, coupled to the multiplexing means; 

v. RF upconverting means coupled to the modulating 
means for channelizing the at least one modulated 
multiplexed digital into the UHF band; 

vi. at least one amplifier coupled to the RF upconvert- 
ing means for amplifying the at least one modulated, 
channelized, multiplexed digital signal; and 

vii. at least one antenna coupled to the at least one 
amplifier for transmitting the at least one amplified, 
channelized, modulated, digital signal; 

c. a return path facility coupled to the program subsystem 
and to the telecommunications system, including pro- 
cessing means adapted for receiving over the telecom- 
munications system communications from the sub- 
scribers; 

d. a plurality of intelligent control boxes, each intelligent 
control box at a subscriber's premises, coupled to the 
telecommunications system, and including: 

i. a tuner for receiving transmissions from the trans* 
mission subsystem; 

ii. an input device for accepting subscriber requests; 
and 

iii. a processor coupled to the tuner and to the input 
device and adapted to assert subscriber requests at 
the return path facility via the telecommunications 
system; 

whereby an aggregation of programming sources may be 
provided point-to-multipoint by way of digital UHF 
broadcast, a plurality of subscribers can assert requests 
in connection with the broadcast, and the return path 
facility can fulfill the requests. 

16. A system for communicating with a plurality of 



wherein the return path subsystem further comprises data 60 subscribers, the communication involving content carried by 



storage means, and wherein the return path subsystem 
processing means is further adapted to create a record 
corresponding to communications received from subscribers 
and to store that record in the data storage means. 

13. The communications system according to claim 12, 
wherein the record corresponding to communications 
received from subscribers contains billing information. 



signals originating from a plurality of content providers, at 
least one of the plurality of subscribers having access to a 
telecommunications system, the system for communication 
comprising: 
a. a program subsystem, including, 

i, a plurality of receivers, each receiver for receiving at 
least one of the plurality of content carrying signals; 
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ii. processing means adapted for modifying the 
received signals, the processing means coupled to 
the plurality of receivers; 

b. a transmission subsystem coupled to the program 
subsystem and receiving from the program subsystem 5 
the received signals, the transmission subsystem 
including: 

i. means for digitizing the signals from the plurality of 
content providers; 

ii. means for compressing the digitized signals, the 10 
compression means coupled to the digitizing means; 

iii. a multiplexer, for multiplexing the digitized signals 
into at least one data stream, the multiplexer coupled 
to the compression means; 

iv. means for modulating the at least one digital data 15 
stream into a radio frequency band, coupled to the 
multiplexing means; 

v. RF upconverter means coupled to the modulating 
means for channelizing the at least one modulated 
multiplexed digital data stream into the radio fre- 20 
quency band; 

vi. at least one amplifier coupled to the RF upconverter 
means for amplifying the at least one modulated 
digital data stream; and 

vii. at least one antenna for transmitting the at least one 25 
amplified, channelized, modulated, digital data 
stream; and 

c. a re rum path subsystem coupled to the program sub- 
system and to the telecommunications system, includ- 
ing processing means adapted for receiving over the 30 
telecommunications system communications from the 
subscribers; 

whereby an aggregation of programming sources may be 
provided point to multipoint to subscribers by way of 35 
digital broadcast and subscriber input regarding the 
broadcast can be taken into account by the communi- 
cations system. 

17. The communications system according to claim 16, 
wherein the processing means of the return path subsystem ^ 
is further adapted to communicate with the program sub- 
system on receiving a communication from a subscriber, and 
the processing means of the program subsystem is further 
adapted to modify the received signals on receiving a 
communication from the return path subsystem, whereby the 4J 
transmission may be modified in response to a subscriber 
request. 

18. The communications system according to claim 16, 
wherein the return path subsystem further comprises data 
storage means, and wherein the return path subsystem 5Q 
processing means is further adapted to create a record 
corresponding to communications received from subscribers 
and to store that record in the data storage means. 

19. A device for permitting a subscriber to interact with an 
asymmetrical data communications system, the device J5 
coupled and the asymmetrical data communications system 
both coupled to a telecommunications system, the device 
having a plurality of ports each for receiving one of a 
plurality of signals, comprising: 

a. an input selector coupled to the plurality of ports and 60 
adapted for switching signals arriving at the plurality of 
ports according to a subscriber selection; 

b. a plurality of receivers coupled to the input selector 
each for receiving a selected signal switched by the 
selector, the plurality of receivers including: 65 
i. a tuner for receiving digital RF transmissions in the 

UHF band; and 



ii. a tuner for receiving analog RF signals; and 

c. a video decoder coupled to the digital tuner; 

d. signal generation means coupled to the video decoder; 

e. an input device for subscriber information input; 

f. a processor coupled to the input selector and the video 
decoder adapted for reading subscriber input informa- 
tion aDd actuating the input selector to effect subscriber 
requests; and 

g. a network interface coupled to the processor and to the 
telecommunications system for transmitting subscriber 
messages to the asymmetrical data communications 
system. 

20. The device of claim 19, wherein the plurality of 
receivers further comprises a DBS tuner coupled to the input 
selector. 

21. The device of claim 19, wherein the plurality of 
receivers further comprises an MMDS tuner coupled to the 
input selector. 

22. The device of claim 19, wherein the plurality of 
receivers further comprises an LMDS tuner coupled to the 
input selector. 

23. The device of claim 20, wherein the plurality of 
receivers further comprises an MMDS tuner coupled to the 
input selector. 

24. The device of claim 20, wherein the plurality of 
receivers further comprises an LMDS tuner coupled to the 
input selector. 

25. The device of claim 21, wherein the plurality of 
receivers further comprises an LMDS tuner coupled to the 
input selector. 

26. The device of claim 23, wherein the plurality of 
receivers further comprises an LMDS tuner coupled to the 
input selector. 

27. The device of claim 19 further comprising a secure 
processor subsystem coupled to the analog tuner for 
descrambling analog input signals that require descram- 
bling. 

28. The device of claim 27 further comprising an EIA-563 
baseband interface coupled to the secure processor sub- 
system. 

29. A method for providing asymmetric data communi- 
cations services, comprising the steps of: 

a. receiving signals from a plurality of content providers; 

b. digitizing the signals from the plurality of content 
providers; 

c. multiplexing the signals from the plurality of content 
providers into at least one data stream; 

d. modulating the at least one multiplexed, digital data 
stream; 

e. channelizing the at least one modulated, multiplexed 
digital data stream into at least one digital RF signal; 

f. transmitting the at least one digital RF signal to a 
plurality of subscribers each having a device for receiv- 
ing and demodulating the at least one RF signal; 

g. receiving over the PSTN a message from at least one 
subscriber receiving device; and 

h. retransmitting to other service providers each of the at 
least one messages from the at least one subscriber 
receiving device. 

30. The method of claim 29 wherein the at least one 
modulated, multiplexed digital data stream is channelized 
into at least one digital UHF signal. 

31. The method of claim 29 wherein the resolution of the 
service is approximately 256 by 240 pixels. 
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continue to infringe the '492 patent unless enjoined by this Court. AT&T will suffer further 
damage and irreparable injury unless and until TiVo is enjoined by this Court from continuing 
such infringement. 

COUNT TWO: INFRINGEMENT OF U.S. PATENT NO. 5,922,045 

15. AT&T incorporates by reference Paragraphs 1 through 14, as if fully set forth 

herein. 

16. United States Patent No. 5,922,045, entitled "Method and Apparatus for 
Providing Bookmarks when Listening to Previously Recorded Audio Programs" (hereinafter, the 
"'045 patent"), duly and legally issued on July 13, 1999 after a full and fair examination. AT&T 
Intellectual Property II, L.P. is the assignee of all rights, title, and interest in the '045 patent, 
including the right to sue and recover for all past infringement. A true copy of the '045 patent is 
attached as Exhibit B. 

17. As an example, and not to be limited to only a single infringing product, TiVo has 
developed, has tested, promotes, markets, uses, and sells services for displaying streaming 
television programs and movies. Such services (or the use or operation of such services) fall 
within the scope of one or more claims of the '045 patent, 

18. TiVo has infringed and continues to infringe the '045 patent, by, among other 
acts, making, using, offering for sale, and/or selling within this Judicial District and elsewhere in 
the United States, without license or authority by AT&T, services covered by one or more claims 
of the '045 patent, including, but not limited to, services for displaying streaming television 
programs and movies. 

19. As a consequence of TiVo's infringement, AT&T is entitled to recover damages 
adequate to compensate it for the infringement complained of herein, but in no event less than a 
reasonable royalty. 

20. TiVo has caused and will continue to cause AT&T substantial damage and 
irreparable injury by virtue of its past and continuing infringement of the '045 patent. TiVo will 
continue to infringe the '045 patent unless enjoined by this Court. AT&T will suffer further 
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An interactive media delivery system enables interactive 
media programming to a multimedia device and also tracks 
a subscriber's use of the multimedia device. For example, 
the device tracks events, such as a change in programming, 
a change in channel selection, and/or the subscriber's inter- 
action with a particular interactive services application. 
Each event may be stored as an event record in a database, 
and one or more of the event records may be merged with 
content data to form event timelines of programming or 
other activity to the multimedia device over a selected time 
period. Further, timelines may be analyzed to generate 
ratings and other information about programming and may 
also be correlated with demographics data for marketing 
analysis. 
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damage and irreparable injury unless and until TiVo is enjoined by this Court from continuing 
such infringement 

COUNT THREE: INFRINGEMENT OF U.S. PATENT NO. 6,118,976 

21. AT&T incorporates by reference Paragraphs 1 through 20, as if fully set forth 

herein. 

22. United States Patent No. 6,118,976, entitled "Asymmetric Data Communications 
System" (hereinafter, the "'976 patent"), duly and legally issued on September 12, 2000 after a 
full and fair examination. AT&T Intellectual Property I, L.P. is the assignee of all rights, title, 
and interest in the '976 patent, including the right to sue and recover for all past infringement. A 
true copy of the 4 976 patent is attached as Exhibit C. 

23. As an example, and not to be limited to only a single infringing product, TiVo has 
developed, has tested, promotes, markets, and sells DVR units that allow for user interaction 
through a communications channel ("interactive DVR units"). Such products (or the use or 
operation of such products) fall within the scope of one or more claims of the '976 patent. 

24. TiVo has infringed and continues to infringe the '976 patent, by, among other 
acts, making, using, offering for sale, selling, and/or importing within this Judicial District and 
elsewhere in the United States, without license or authority by AT&T, products and/or processes 
covered by one or more claims of the '976 patent, including, but not limited to, interactive DVR 
units. 

25. As a consequence of TiVo's infringement, AT&T is entitled to recover damages 
adequate to compensate it for the infringement complained of herein, but in no event less than a 
reasonable royalty. 

26. TiVo has caused and will continue to cause AT&T substantial damage and 
irreparable injury by virtue of its past and continuing infringement of the '976 patent. TiVo will 
continue to infringe the '976 patent unless enjoined by this Court. AT&T will suffer further 
damage and irreparable injury unless and until TiVo is enjoined by this Court from continuing 
such infringement. 
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METHOD AND SYSTEM FOR TRACKING 
NETWORK USE 

This application is a continuation of U.S. application Set. 
No. 08/779^06, filed with the U.S. Patent Office on Jan. 6, 
1997, now abandoned. 

This invention is a method and system for tracking 
subscriber use of network applications, particularly network 
applications involving delivery of interactive media or video 
programming. 

BACKGROUND OF THE INVENTION 

Broadcast and cable television have long dominated the 
visual media market. New communications technologies, 
however, have accelerated demand for new types of media 
such as video on demand, interactive video, interactive 
gaming, home shopping or interactive advertising. Unlike 
broadcast television, viewers of these services typically are 
paying "subscribers," although payments from advertisers 
also pay a large share of the costs of providing these media 
services. 

To gauge the effectiveness of their spending, advertisers 
have long sought information on viewers 3 viewing patterns. 
A number of devices and techniques exist for gathering such 
information. For instance, U.S. Fat. No. 4,258,386 to Che- 
ung and U.S. Pat. No. 4,556,030 to Nickerson, et al„ 
describe the general concept of deploying in viewers' homes 
devices for monitoring a viewer's television set ("TV") in 
order to accumulate data illustrating viewing habits such as 
which channels were watched at particular times. Accumu- 
lated data is then forwarded via telephone lines to a central 
location for analysis. Cheung sends data from particular 
monitoring stations at a preselected, specific "window" of 
time; interruptions to transmission during that window result 
in the Cheung system forwarding the data at another time. 

Other systems and methods provide somewhat more use 
data than just channel numbers viewed and time of viewing, 
Typically, however, the information is for a smaller subset of 
users. Thus, U.S. Pat. No. 4,816,904 to McKenna, et al. f U.S. 
Pat. No. 4,912,552 to Allison, III, et al. and U.S. Pat. No. 
5,374,951 to Welsh, all disclose monitoring "panelist" TV 
use in order to collect data about panelist viewing patterns 
as well as certain marketing information. Generally, panelist 
monitoring is used to gauge the effectiveness of advertising 
on selected groups of "panelists," each of which is one 
household in a group comprising a "panel," typically located 
in a particular geographical area. 

Monitoring not only determines which commercial and 
TV programs the panelist views but also may be used to 
gather information about which products panelists purchase. 
For instance, the U.S. patent to McKenna discloses a remote 
data collection unit located at a panelist home that monitors 
viewer identification data and TV functions (e.g., channel 
viewed, VCR viewing time oi game time). Additionally, a 
wand is provided for inputting bar codes of purchased items. 
Monitored data is sent via the telephone network to a central 
location, which can also download questionnaires to the 
panelist and receive responses. Allison and Welsh disclose 
similar monitoring systems and methods. Instead of simply 
monitoring the channel number that a panelist was viewing 
at a particular lime, Welsh discloses monitoring identifica- 
tion information carried in the television signal vertical 
blanking interval that identifies preselected commercials. 
After detecting and storing the identification information 
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that identifies particular commercials viewed by panelists, 
the data is transmitted by telephone to a central location for 
analysis. 

Monitoring systems also have been used with some early 

5 interactive media systems. U.S. Pat. No. 5,404,393 to 
Remillard discloses an interactive TV system. Among other 
elements of the system, a controller monitors TV channels 
and time/date stamps the selected channel so that, indirectly, 
viewers* programming choices may be monitored. Data is 

30 assembled into a "user profile," which is uploaded to an 
appropriate facility via the telephone network. 

Nevertheless, while panelist monitoring systems like 
those of Allison, McKenna and Welsh or interactive televi- 
sion monitoring systems like Remillard 's provide somewhat 

15 more monitoring data than just TV tuning data, they do so 
only for limited groups. For example, when more data is 
gathered (like purchase information), it is done only for the 
panelist groups, rather than for subscribers to the entire 
system. Also, systems like McKenna's that uses a wand for 

20 scanning bar codes are intrusive systems that require user 
action to collect data rather than collecting data passively 
and automatically. Other systems contemplate capturing 
only some of the data generated by subscriber's viewing 
activities or only some of the ratings information. For 

25 instance, previous systems typically capture ratings infor- 
mation that identify television shows viewed rather than 
whether the subscriber viewed commercials displayed dur- 
ing those shows. 

3Q Perhaps more importantly, none of the systems described 
attempt to match "raw" information on channels viewed 
with programming information. Nor do those systems match 
viewing pattern information with demographics information 
about the particular users in order to provide more "targeted" 

35 advertising. 

SUMMARY OF THE INVENTION 

The present invention uses a collector, associated with a 

40 subscriber's set top box ("STB"), to obtain data about any 
"events" — subscriber actions or changes in 
programming — that are of interest. Data about virtually any 
events, from channels watched to volume changes to inter- 
active applications invoked, may be captured with the col- 

45 lector. Event records comprising such data, as well as the 
identity of the application involved and the event time, are 
buffered. Periodically or on command, event records are 
uploaded from the buffer to a merge processor such as 
through art interactive network that allows for duplex com- 

50 munication with the STB. The merge processor, which may 
be a head end server or a workstation computer forming part 
of or coupled to the media delivery network, receives (1) the 
event data and (2) content data that identifies programming 
content broadcast or delivered throughout the region in 

55 which the system is deployed. Timelines showing particular 
events over time may then be generated for each subscriber. 
Rather than just determining the channel viewed and time of 
day, the event timelines describe the programming or inter- 
active applications selected by or shown to a subscriber over 

60 a selected period of time (e.g., 24 hours). 

The merge processor may further filter this collected and 
merged data to generate reports ranging from descriptions of 
a single user's viewing patterns to very high level viewing 
patterns showing the number of users who watched or 

65 participated in a particular program for a selected time 
period. Further, that information can be combined with 
billing and demographics information to provide detailed 
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information on a particular subscriber's or group of sub- BRIEF DESCRIPTION OF THE DRAWINGS 
scribers' viewing and related buying patterns. 

The present invention thus involves a method for obtain- FIG. 1 shows a block diagram of elements of one embodi- 

ing detailed information on every application invoked by a meat of the system of the present invention, 

subscriber and information about the type of programming 5 FIG. 2 shows a block diagram of a Set Top Box as used 

shown. The first step is to identify data that describe the with the embodiment of the present invention shown in FIG. 

events of interest that occur. Those events include: the 1 and provided with a clickstream processor, 

channel viewed, a switch to another channel, a passive FIG. 3 shows a schematic diagram showing the upload 

change in programming because of a commercial break or cycle for collected event data. 

change to a new program, use of a VCR or other ancillary 10 FIGS. 4Aand 4B show the upload of collected event data 

device, or invocation of an interactive application and sub- from a selected Set Top Box through the network to the 

scriber commands given to the system during the applica- staging server shown in FIGS, 1 and 5, 

tion. Event data also includes start and stop times, identifi- FIG. 5 shows an overview of the staging server, its 

cation of the subscriber's STB or specific data needed to be functions and its interconnections with various data sources, 

recorded for any particular interactive or other application. is FIG. 6A shows the system elements required for merging 

Event records are formed from this collected data and and parsing the event and content data collected by the 

buffered before uploading through the interactive or other present invention. 

media delivery network to a headend, server or third party FIG. 6B shows the assignment of priority to content data 

data analysis system. Before uploading, the captured data necessary for completing the merge and parse process, 

may be compressed and formed into packets for transmis- 20 FIG. 7 shows the results of a merge and parse process of 

sion. the present invention. 

Using the system or method of the present invention 

allows service providers to obtain ratings information and DETAILED DESCRIPTION OF THE DRAWINGS 
detailed information on subscriber viewing patterns and 

subscriber use of interactive applications. Thus, the present 25 System Overview 
invention can track the number of subscribers viewing or 

watching particular programs, including advertisements. It FIG. 1 shows a block diagram of the components of the 

also can track use of particular interactive applications such system 20. System 20 is a demographics and programming 

as video on demand. The invention automatically matches ratings collection and analysis system that may be deployed 

data describing programming content with event data 30 for use on an interactive media delivery system such as the 

describing a channel or application activated or controlled Interactive Video Services Network deployed by BellSouth 

by the subscriber. This allows the invention comprehen- Interactive Media Services. That interactive system is 

sively to track user "channel surfing." Also, the invention described in co -pending application Ser. No. 08/428,718, 

can compare subscriber demographics or billing information assigned to the assignee of the present invention and which 

with viewing pattern information in order to tailor commer- 35 document is hereby incorporated in its entirety by this 

cials to those subscribers; determine whether subscribers reference. However, persons skilled in the art will recognize 

with a selected demographic background viewed a commer- that the present invention may be used with any of a variety 

cial of interest; or determine the demographics of subscrib- of interactive media delivery systems, standard or wireless 

ers that viewed selected commercials. cable television systems, satellite television systems or other 

Persons skilled in the art will recognize that the present 40 media delivery systems that allow duplex communication 

invention may be used with numerous types of networked (perhaps with the return path via a separate (e.g., telephone) 

media delivery systems. For instance, the method or system network) to a a set top box ("STB") 30 coupled to a 

of the present invention can be deployed on an interactive subscriber's display device, such as a television set or the 

media delivery system or modified for use with a conven- like. 

tional cable television network, a wireless cable television 45 In any event, FIG. 1 shows various system 20 elements 
network, or a home satellite television network. and subsystems that communicate with each other to trans- 
It is accordingly an object of the present invention to mil collected information, data error detection schemes and 
provide a system and method for collecting information data acknowledgments. Briefly, the STB 30 communicates 
about patterns of subscriber viewing and use of a media through a distribution network 52 with a video server 60, 
delivery system. so such as a video transfer engine ("VTE"), that may be 
It is another object of the present invention to provide a acquired from Hewlett Packard ("HP"), with a video/object 
system and method for determining which network appli- storage database 54. Video server 60 couples to a video 
cations, particularly interactive applications, are invoked by control server 56, such as an Inter Media Server available 
particular subscribers. from Sybase and deployed on a platform such as an HP 
It is an additional object of the invention to provide a 55 9000, with a database 58. The video server control 56 
system and method for communicating collected inform a- controls video server 60 and also logs information about 
tion to a merge processor. video server 60 use. A staging server 70 receives collected 
It is a further object of the invention to provide to the records of events of interest. These "event records" pass 
merge processor information about the programming con- through the video server control 56, which also couples to a 
tent distributed over the media delivery system. 60 Marketing and Information System ("MKIS") 100 that 
It is yet another object of the invention to provide a couples to staging server 60, which receives (1) the event 
system and method for merging the collected information records and (2) content data from various sources 120, 140 
with the programming information in order to obtain com- and 160 identified in FIG. 1 and which describe program- 
prehensive information about programming shown to or ming content available through the interactive network to all 
network applications invoked by subscribers. Other objects, 65 subscribers. MKIS 100 may be coupled to a third party 
features and advantages of the present invention will search and analysis system 110 that can provide customer 
become apparent upon reading the rest of this document. support operations. 
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STB 30 provides a platform by which (1) content is stream data going to the staging server 70 and as a pass- 
converted to a selected video format (e.g., NTSC or PAL) through device for staging server 70 data acknowledgments 
and presented to the subscriber or (2), for interactive sys- to the STBs 30. Also, video server control 56 may provide 
terns, messages are exchanged (including video data) over a log information that identifies interactive applications 
network 52 with the staging server 70. STB 30 also could 5 invoked by particular STBs 30. That log information is 
include platforms capable of: (1) receiving messages from a provided to the staging server 70 so that video server control 
user input device, such as a hand-held remote control unit; 56 also acts as another data source about content available 
(2) translating video signals from a network-native format over the network, like EPG metadata source 120, broadcast 
into a format that can be used by the television or display advertising metadata source 140, or advertising traffic con- 
device; (3) inserting alphanumeric or graphical information 10 trol metadata source 160. Staging server 70 collects all such 
into the video stream in order to "overlay" that information clickstream data and content data, analyzes and then for- 
on the video image; (4) providing graphic or audio feedback wards it to MKIS database 100 or to a third-party analysis 
to a user; or (5) possibly the most basic function, simply engine and database 110, as described in more detail in the 
routing a traditional broadcast signal to a viewing device text associated with FIGS. 5-7. 
connected to the STB 30. Analogous terms to STB include; is 

Set-Top Terminal ("STT"), Cable Converter, and Home Joumaling of Event Data 

Communications Terminal ("HCT") and any of these 

devices may be coupled to or made a part of a display device Clickstream processor 34 collects information to create a 

for showing programming to subscribers. Generally, STB 30 "journal" or log about all events or selected events of 

may be a Richmond or 8600X available from Scientific 20 interest. An event is an action or a change in the state of a 

Atlanta, a CFT 2200 available from General Instruments, STB 30 that is deemed important to building a knowledge 

Thomson's DSS or any other device equipped with (1) a base on subscribers or their viewing patterns, For example, 

microprocessor; (2) memory for operating instructions and an event can include key presses to change channels or 

storage; and (3) a control interface for accepting subscriber volume, mute, to enter the navigator for the interactive 

commands from a remote control device or control panel. 25 system, to rum the STB 30 off or on, to fast forward, to pause 

For the particular embodiment of system 20 shown in the or to rewind a video obtained via the video on demand 

Figures, collected event records that are packaged for trans- application. The events include applications called by the 

port through system 20 are called "clickstream" data or subscriber, such as interactive gaming applications, an elec- 

information. FIG. 2 shows a clickstream processor 34 that tronic program guide, a video on demand or near video on 

resides in the memory, such as DRAM or the like, of an STB 30 demand application, a home -shopping application or a par- 

30 and which has a clickstream kernel 36, buffets 42 or 44, ticular company's interactive application, such as The 

a clickstream upload handler 40, a clickstream controller 38 Weather Channel's weather on demand, World Span's travel 

and a clickstream event API (application programming on demand or Light Span's educational interactive applica- 

interface) 41. tion. Events include subscriber use of and control commands 

Briefly, the clickstream kernel 36 buffers events passed to 35 to peripheral devices coupled to the STB 30 or a subscriber's 
it by various network applications through the clickstream display device, such as a VCR or videodisk player, 
event API 41. Clickstream controller 38 accepts control Each application residing on the STB 30 interfaces with 
messages from staging server 70 and appropriately stores the clickstream processor 34 to send selected data for 
their pay load. Typical messages may be sent over the maintaining a desired journal. Assuming that the system 20 
Extended Super Frame ("ESF") pass-through data link and 40 is used with an interactive system, many different applica- 
control the uploading of clickstream data. Clickstream tions may be deployed over that system and may be trig- 
upload handler 40 accepts control messages over the system gered by the subscriber. Some fairly typical applications that 
20, which messages control the uploading of collected might be invoked include: 

clickstream data over the reverse path through network 52. a cable television application that handles subscriber 
Also, the clickstream upload handler 40 stores the payload 45 remote controls (like channel or volume changes); 
of these messages in appropriate and available memory and an electronic programming guide application such as TV 

accepts the messages sent to it to acknowledge the receipt of Data, Prevue or Star Sight interactive services; 

uploaded clickstream data. an interactive game; 

Referring again to FIG. 1, video server 60 provides a video on demand or near video on demand application; 
information from video/object storage 54 to the particular 50 company S p ec ifi c applications, that might be offered by 
interactive system over which system 20 is deployed. Click- content provider such as the Weather Channel, MTV, 

stream data collected at STBs 30 can be uploaded to staging Showtime etc ■ or 

server 70 in any number of ways. For instance FIG . 1 shows a navigator a ppi icatiori l0 help the user choose options, 
that the distribution network 52 could couple directly to 

staging server 70, allowing clickstream data packets sent 55 Each of these applications, as well as some internal appli- 

from STBs 30 to be forwarded to staging server 70 directly cations that the system 20 may wish to monitor, will be 

and for staging server 70 to then return via the network 52 assigned a unique application identifier, 
data acknowledgements. A network management controller Clickstream processor 34 interfaces with the various 

50 controls the flow of informationb through the network 52. applications resident in the STB 30's operating system 32 

Alternatively, FIG. 1 and, in greater detail, FIG. 4B, show 60 and any third party applications 33. Note that for systems 

that clickstream data packets may be sent to the distribution using other types of STB 30's than the embodiment 

network 52 to the video server 60. Video server 60 passes described in the Figures, those STB 30's need not have an 

through both clickstream data uploads from various STBs 30 operating system. Instead, all instructions can be written 

and data acknowledgments returned to the STBs 30. A directly to the memories of those particular STBs. Applica- 

communications router inside the video server 60 redirects 65 tions 33 can be added by either downloading entirely new 

traffic to the appropriate destination. Video server control 56 software directly to memory or by downloading new tables 

similarly acts as a pass-through device for STB 30 click- as described below. 




US 6,983,478 Bl 

7 

When an application 33 reaches a point where an "event" 
of interest has been generated, the application 33 stores an 

event record to memory. The application 33 then launches to 

the clickstream kernel 36 the event record, including infor- 
mation such as: (1) the application's 33 identification code s 

(e.g., the "Cable Television Application" or a particular 

interactive application); (2) a count of the amount of infor- 
mation (number of bytes) to be journaled; (3) a "time stamp" 
that defines a unique point in time, e.g., by defining the date 
and time of day, accurate to the hour, minute or second; (4) 10 
an identification code for the event, or (5) where the event 
data was stored. Clickstream kernel 36 uses the information 
provided by the applications 33 to collect the event data, 
format it and place it into a buffer 42 or 44. Table I shows 
the type of information that will be generally sent by the 15 
clickstream processor 34 to the buffers 42 or 44. 

TABLE I 



Application Event Record 



Size 



Timestamp 6 bytes 

Assigned Application ID 36 bits 

Number Bytes to Follow (length) 8 bits 

Application Specific Data with customized formats and Multiple 

lengths Bytes 



Global table II defines events of interest that each appli- 
cation can identify, collect, store in the "Application Specific 
Data" field and notify the clickstream kernel 36. These 
events could be as simple as a broadcast channel change by 
pressing the "Chan Up" remote key. All of these event types 
can be accessed and used by each application. While each 
application may not use every possible event type, the 
number of events available for collection allows system 20 
to extract any pertinent usage information for analysis. Also, 
the use of the global table II increases system 20 efficiency 
because event types can be modified, added or removed. 

TABLE II 



EVENT DEFINITIONS 
Code Event 
Content Related Events 



0x0000 Passive Content 

Change 
Direct Key Presses 



0x0001 


tv <> rrv 




Pressed 


0x0002 


Power Pressed 


0x0003 


One (1) Pressed 


0x0004 


Two (2) Pressed 


0x0005 


Three (3) 




Pressed 


0x0006 


Four (4) Pressed 


0x0007 


Five (5) Pressed 


OxOOOfi 


Six (6) Pressed 


0x0009 


Seven (7) 




Pressed 


OxOOOA 


Eight (8) 




Pressed 


OxOOOB 


Nine (9) Pressed 


OxQOOC 


Zero (0) Pressed 


OxOOOD 


Channel Up 




Pressed 


QxOOOE 


Channel Down 




Pressed 


OxOOOF 


Volume, Up 




8 



TABLE II-continued 



EVENT DEFINITIONS 



Code Event 



Pressed 

0x0010 Volume Down 

Pressed 

0x0031 Last Channel 

Pressed 
Application/State Switching 
Related 



0x0028 


AC Power ON 


0x0029 


Application 




Switch (Normal) 


OX002A 


Application 




Switch 




(Abnormal) 


OxO02B 


Application 




Terminated 




(Normal) 


OxOQ2C 


Application 




Terminated 




(Abnormal) 


Ox002D 


Soft Power OFF 


Ox002E 


Soft Power ON 


Ox002F 


OFF State 




Polling Event 




Genera] 


0x0030 


Direct Channel 




Change 


0x0031 


Mute 


0x0032 


Un-Mute 


0x0033 


Volume Change 




Below 50% 


0x0034 


Volume Change 




Below 25% 


0x0035 


Volume Change 




Below IQ% 


0x0036 


Volume Change 




Above 50% 


0x0037 


Volume Change 




Above 25% 


0x0038 


Volume Change 




Above 10% 


0x0039 


Change to 




Interactive 




Mode 


0x003A 


Change to 




Broadcast Mode 



Note that Table II defines relative volume changes (e.g. 
"volume change below 50%," "volume change below 25%," 
etc.). Although the applications could capture the actual key 
presses that lead to these relative volume changes, that level 
of detailed information is of little use to system 20 operators. 
Also, capturing all that detail leads to more records and 
higher demands upon the transmission network 52 when 
those records are uploaded. Applications could also be 
configured to "filter" other unwanted details about other 
subscriber activities. For example, when subscribers "chan- 
nel surf by quickly flipping through a number of channels 
in a short period of time, the application could be configured 
not to record channel changes unless the subscriber paused 
for greater than a certain selected time period (e.g., 15 to 30 
seconds). Again, this eliminates information of little use and 
decreases network traffic. 

Table III defines a small portion of a sample global 
channel identification table that proposes codes for identi- 
fying national and local broadcasters. Such a table allows 
any application journaling events which occur while sub- 
scribers are viewing broadcast or cable television programs 



45 



50 
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to identify the network carrying the programming content by 
using a subset of the global table II. In this way channel 
lineups can be changed yet the identifier for a broadcast or 
cable network would stay the same. The use of this mappiDg 
scheme eliminates the need to map an ever-changing chan- 
nel number to a network. 

TABLE HI 

Broadcast Channel 
Identification 



0x0100 to 


NcwsAalk 


OxOllF 


Shows 


0x0100 


CNN 


0x0101 


Headline News 


0x0102 


The Weather 




Channel 


0x0103 


CNBC 


0x0104 


CSPAN 


0x0105 


CSPAN-2 


0x0106 


America's 




Talking 


0x0107 


Talk Channel 


0x0108 


Court TV 


0x0109 


The Crime 




Channel 


0x01 OA 


National 




Empowerment 




TV 


0x0120 to 




Ox013F 


Sports 


0x0120 


ESPN 


0x0121 


ESPN-2 


0x0122 


SportSouth 


0x0123 


The Golf 




Channel 


0x0124 


Classic Sports 




Network 


0x0125 


Prime Network 


0x0126 


NewSpoit 


0x0140 to 




0x0l5F 


Music 


0x0140 


MTV 


0x0141 


VH-1 


0x0142 


Country Music 




Television 


0x0143 


The Nashville 




Network 


0x0144 


The Box 


0x0145 


Video Jukebox 


0x0146 


MOR Music TV 


0x0147 


Music Choice 



TABLE IV 




Application Identifiers 


ID Code 


Content 


0x0000 


Operating System 


QxOOOl-F 


Operating System Sub-Systems 


0x0010 


Application Manager 


0x0011 


Cable Television Application 


0x0012 


Clickstream IKcrncl 


0x0100 


EPG System 


0x0103 


Digital Pictures - Interactive Game 


OxOllO-F 


Viacom - MTV/Showtime, etc. 


0x1000 


Interplay Written Applications General ID 


0x1001 


Interplay Runtime Engine 


0x1002 


Interplay Navigator 


0x1003 


Interplay VOD 


0x1004 


Interplay NVOD 


0x1005 


Interplay TownGuide 


0x1100 


The Weather Channel, Weather On-Demand 


0x3101 


Worldspan - Travel Oa-Demand 


0x1102 


Lightspan - Educational Interactive Application 


OxFFFF 


Missed Events Record 



Table IV below shows some possible identification codes 
for particular applications. Note that each application could 
be programmed to insert its application ID code into the 
event record without accessing table IV. But by having each 
application access the table IV during the joumaling process, 
the system's 20 ability to modify or add application ID codes 
easily is enhanced because such codes could be populated 
across system 20 by downloading an updated table IV. 
Providing for downloading of new tables increases the 
application footprint and system 20 complexity so tables can 
also be part of the application programming. 



Each particular application can simply reference the glo- 
bal application, event and channel identification tables 
(which periodically may be updated and then downloaded to 
STBs 30) in order to build an event record. Examples of 

30 application specific event records that may be created in this 
manner are shown in Tables V through VIII below and 
discussed in associated text. 
A cable TV application 33 may tune analog or digital 

35 broadcast services. When a command to change channels is 
entered, the cable TV application 33 is invoked. The cable 
TV application 33 begins building an event record by 
inserting an application ID and time stamp into the record. 

40 Next, the application 33 dctenniines the "event ID 1 ' by 
cross-referencing the command with the global event ID 
table II for the proper code. Then, the application 33 journals 
the "Channel ID." 

45 Although the Channel ID could simply be the number of 
the channel, that information means little. The fact that 
channel 6 was watched more than channel 7 has little or do 
meaning unless networks and, ultimately, the content deliv- 

5q ered by those networks are associated with particular chan- 
nels. Accordingly, the Channel ID may be a field, like a 16 
bit field, which uniquely identifies the broadcast network 
displayed on that particular channel. The Channel ID may be 
determined by programming the cable TV application 33 to 

55 compare the channel number tuned with global broadcast 
channel identification table II, above, to determine the 
correct channel identification code. Correlating the channel 
number with the channel identification code found in Table 
III ensures accurate reporting even though channels may 

60 differ at different cable TV headends within a particular 
region or even though individual channel line-up changes 
may be made over a period of time. This correlation between 
channel number and channel identification code could be 

6S done also at the staging server 70 after it receives all of the 
event records, provided that correlation there accounted for 
different regional channel lineups. 
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TABLE V 



TABLE VH-continued 



Oiblg TV Applicati on Event Record 



Size 



TABLE VI 



Navigator Application Eveot Record 



Application ID: See Application ID table IV 


16 bits 


Timestamp: Identifies event time 


6 bytes 


Event ID; See Global Event ID table for Syntax 


16 bits 


Application State ID: See below for information 


8 bits 


tracked: 




Fly-Thru 


0x00 


Main Menu 


0x01 


Information (Help) Screen or Video 


0x02 


Movies Sub-Menu 


0x03 


Movie Categories Sub-Menu 


0x04 


List of Movies Sub-Menu 


0x05 


Movie Info Screen 


0x06 


Movie Buy State 


0x07 



Table VII similarly shows the joumaling information 
collected for a video on demand application 33 that may be 
launched in an interactive service from the Navigator appli- 
cation above or its equivalent. Some of the information 
collected here may include the amount of pausing, fast 
forwarding and rewinding. Additionally, the service pro- 
vider may want to determine whether viewers are recording 
a video in order to charge them a recording fee. Similar 
information could be collected for a near video on demand 
service, which typically allow only incremental pause, for- 
ward or rewind. 



Video on Demand Application Event Record 

Size/Data 



Application ID: See Application ID table IV 16 bits 

Timestamp: Identifies event time 6 bytes 

Event ID: See Global Event ID table It for Syntax 16 bits 

Channel ID: See Broadcast Channel ID table III for Syntax 16 bits 



Table VI below shows a navigator application that may be 
provided in order to give subscribers an interactive menu 
that assists them in selecting from the many available 
programs and applications in an interactive network. The 
"Event ID" refers to the identification codes for commands 
relating to the Navigator application, which codes may be 
located by referring to the global event ID table II above. 
Table VI also shows some of the features of the navigator 
that might be used by the subscriber and that could be useful 
to track. The right hand column under "Size/Data" shows, 
first, next to the "Application state ID" that 8 bits are 
allocated to that record and, second, in the various rows 
beneath, the particular code mat is journaled in order to 
indicate a subscriber accessed the identified (e.g. Fly -Thru, 
Main Menu, etc.) screen, Such information lets system 20 
operators determine the screens that users are viewing 
heavily or lightly in order to replace less popular screens 
with more useful ones or to charge more for advertisements 
placed on heavy use screens. 



Event ID: See Global Event ID table for Syntax 


16 bits 


Application State ID: See below for information 


8 bite 


tracked: 




Playing 


OxOQ 


Paused 


0x01 


Fast Forward 


0x02 


Rewind 


0x03 


Info (Help) Video or Screen Played 


0x04 


reserved 


0x05 


reserved 


0x06 


reserved 


0x07 



Table VIII below shows the event record for the Elec- 
tronic Program Guide (EPG) application 33. The EPG 
application 33 records the application ID, timestamp and 
20 event ID records just as do the above applications described 
in tables V-VTI. Additionally, it has an application 33 state 
ID field that identifies which of the display screens were 
accessed by subscribers, as shown below. 



TABLE VIII 



Electronic Program Guide (EPG) Application 
Event Record 



Application ID: See Application ID table IV 


36 bits 


Times tamp: Identifies event time 


6 bytes 


Event ID: See Global Event ID table for Syntax 


16 bits 


Application State ID: See below for information 


8 bits 


tracked: 




Initial Display Screen 


0x00 


Look Ahead Display 4 Hour 


0x01 


Look Ahead Display 8 Hour 


0x02 


Look Ahead Display 12 How 


0x03 


Look Ahead Display 16 Hour 


0x04 


Look Ahead Display 20 Hour 


0x05 


Look Ahead Display 24 Hour 


0x06 


Reserved 


0x07 



Generally, similar information about other applications 
33, such as home shopping, interactive gaining or any other 

45 new applications deployed over an interactive or other 
media delivery system, can be tracked in a similar fashion. 
Additionally, the journaling process may be used to track 
errors within the system 20, with clickstream kernel 36 
joumaling such errors using the same method as described 

so above. 

Over time, the joumaling needs of system 20, or system 
20 itself may evolve. Applications may be changed or new 
ones deployed. New events may become of interest to the 
operator of system 20. In order to provide flexibility for 
55 system 20, operators may download to STBs 30 new or 
replacement applications that will include the necessary 
processes for joumaling all events of interest. 



TABLE VII 



Video on Demand Application Event Record 

Size/Data 



Application ID: See Application ID table FV 
Timestamp: Identifies event time 



16 bits 
6 bytes 



Sample Journal 

60 

Assume that Mr. Smith turns on his interactive television 
at 7:30 p.m. to watch a half hour news program on channel 
5, which corresponds to CNN for that region. At 8:00 p.m. 
he accesses the Navigator application to order a video 
65 through the video on demand application. He then accesses 
the Video on Demand application, which automatically 
begins playing a video at 8:04, pauses the video at 8:50 and 
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begins playing again at 8:55 until it is completed at 9:45, al 
which point he turns off his interactive TV. 

Mr. Smith's activities generate the following event 
records shown in table IX below (for convenience, multiple 
events occurring under a single application are grouped even 
though separate records are created in operation): 

TABLE IX 

Sample Event Records 



14 

Event Record Upload Cycle 



Cable Application Event Record 1 Content 

Application ID: See table IV for application ID Code 
Timestamp: Identifies event time 

Event ID: See Global Event ID table H to retrieve 

code for "power pressed" 

Cable Application Event Record 2 and 3 Content 

Application ID: See table IV for application ID Code 
Timestamp: Identifies event time (Date will be same 
for second entry) 

Event ID: See (1) global Broadcast Channel ID table 
III to determine that Channel S is CNN and locate 
code and (2) table II for an event ID code 
corresponding to an "iTV Press" by Mr. Smith. 
Navigator Application Event Record 4 Content 

Application ID: See table IV for application ID Code 
Tuncstamp: Identifies event time for accessing each 



Event IDs: See table II for event ID code that 
identifies an "enter' 1 command by Mr. Smith to Invoke 
this application. 

Application State ID Code: This shows Mr. Smith 
accessed the Main Menu 

Navigator Application Event Records 5-6 Content 

Application ID: See table FV for application ID Code 
Timestamp: Identifies event time for accessing each 
screen. A separate record is created for each activity, 
with a timestamp showing initiation of each activity. 
Each record will have the corresponding event and 
state. 

Event TDa: See table II for event ID code that 
identifies an "enter" command by Mr, Smith to invoke 
this application. 

Application State ID Codes: This shorn Mr. Smith 
accessed the Movies Sub-Menu and Movie Sub-menu 
list. 

Video on Demand Application Event Records 7-9 
Content 

Application ID: See Application ID table IV (same for 
each record). 

Timestamp: Identifies event time for each event 
recorded by the application. (The day is the same for 
each record and each lime corresponds with the 
activity identified below). 

Event ID; See table II for event ID codes that identify 
Mr. Smith's play, pause and play commands. 

Application State ID Codes: These show Mr. Smith 
activated this application, played, paused and then 
played again his selected video. 
Coble Application Event Record 10 Content 

Application ID: See table IV foT application ID Code 
Timestamp: Identifies event time 

Event ID: See Global Event ID table II to retrieve 
code for "poweT pressed" 



0x001 J 

1/1/96 

7:30:01 p.m. 
0x002 



0x0011 

mm 

7:30:03 p.m.; 
8:00:01 p.m. 
0x0100 
0x0001 



0x1002 

mm 

8:01:30 p.m. 
0x0021 



0x1002 

mm 

8:02:00 p.m.; 
8:03:00 p.m.; 



0x0021 
0x0021 



0x03 
0x05 



0x1003 
1/1/96 

8:04:00 p.m. 

8:50:00 p.m. 

8:55:00 p.m. 

0x0022 

0x0024 

0x0022 

0x00 

0x01 

0x00 



0x0011 

mm 

9:45:00 p.m. 
0x002 



The variably sized event records are collected and then 
stored in one of two clickstream buffers 42 or 44. Capacity 

5 of each of the buffers may be statically provisioned or the 
system 20 may addressably download to particular STBs 30 
an appropriate buffer 42 or 44 size. A buffer 42 or 44 may 
be an allocated, contiguous free area of STBs' 30 memory 
set aside for buffering event records only. Although 

10 advanced database techniques like link lists or record point- 
ers could be used, they would increase the application 
footprint and complexity. Because buffer sizes of about 15 
kB would probably accommodate the joumaling needs of 
most applications, advanced database techniques need only 

15 be used for larger buffers. Buffers up to 15 kB should allow 
at least 4 to 8 hours of peak channel "surfing" between 
uploads (channel surfing typically will generate the most 
event records). In any event, empirical analysis of network 
use should determine the optimum buffer size. 

20 Event records are directed to one of the two buffers 42 or 
44, although a single or even more buffers could be used 
with the system 20. Conceivably, the system 20 could also 
be modified to upload event records in real time; however, 
that severely increases the possibility of instantaneous over- 

25 loads in network traffic. Thus, system 20 preferably uses 
buffers 42 or 44 to buffer collected event records until they 
are upload. 

Event records from a particular STB 30 may be uploaded 
in a format that assists in their transmission back through the 

30 distribution network 52 to the staging server 70. A header 
record may indicate the time the buffer 42 or 44 was first 
opened, the number of bytes in the buffer 42 or 44, the 
originating STB 30 by address, the version of the click- 
stream kernel 36 which generated the record and the type of 

35 data compression used on the following data (if any). This 
first header record may be of fixed length and uncompressed. 
Information following "Compression Type" may be com- 
pressed to save in transmission bandwidth. Table X below 
shows this general header format: 

40 

TABLE X 

Buffer Header Record 

Size 

45 

Transaction Code 8 bits 

Clickstream Version Number 8 bits 

Timestamp 6 bytes 

Number of Bytes 8 bits 

STB Unique Address Most Significant 3 6 bits 

50 STB Unique Address Least Significant 32 bits 

Compression Type 8 bits 



When (1) a buffer 42 01 44 fills, (2) an upload timer event 
expires or (3) upon command from the staging server 70, the 

55 clickstream processor 34 initiates an upload process. During 
that process the uploading buffer 42 is locked and subse- 
quent event records are routed to and stored in the second 
buffer 44. When upload of buffer 42 is completed, records 
continue to buffer 44 until the next upload time, after which 

60 buffer 44 locks and records go to buffer 42. This cycle 
continues to repeat. 

FIG. 3 shows an upload cycle diagram illustrating one 
method of evenly distributing increased traffic on the net- 
work 52 caused by upload of event records. The clickstream 

65 upload cycle consists of several parameters that define a start 
time and a cycle over which the uploading of data occurs. 
The "first occurrence" parameter defines a starting time in 
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history from which the cycle runs. The "cycle time" param- 
eter defines the amount of time which elapses between 
periods of the upload cycle. When a cycle is complete the 
"upload duration" time starts, and the clicks tre am processor 
34 of each STB 30 will randomize an exact upload time 5 
within the upload duration. This timing of upgrades will 
distribute the network load evenly over the entire upload 
duration period. 

An example of the use of these parameters would be to 
define a period of time every day for STBs 30 within system no 
20 to upload data. Typically, the system 20 operator may 
want the data available every morning for analysis. Peak use 
of broadcast prime time or of interactive services will 
typically be from 7 p.m. until 12 p.m., during which time no 
uploads should occur in order to minimize the burden on the 15 
network 52. Beginning at 12 p.m., uploads of event records 
out of a buffer 42 or 44 would begin. In order to have all 
STBs 30 upload before 8 a.m., the STBs 30 may be divided 
into upload groups, e.g., 32, with each group uploading over 
a selected (e.g., 15 minute) period. To achieve this upload 
cycle, the following parameters are defined in the FIG. 3 
cycle in table XI: 

TABLE XI 

Upload Cycle Parameters 25 
Parameter Definition 
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TABLE Xll-continued 



Clickstream Upload Control Commands 



Octet* Contents 





Cycle First Occurrence 


• 

Year (b8) Defines the lime for 




Start Time CTotaJ b48) 


first upload in cycle. 




Cycle First Occurrence 


Monte (bo) 




Start Time 


8 


Cycle First Occurrence 


Day (b8) 




Start Time 




9 


Cycle First Occurrence 


Hour (b8) 




Start Time 




A 


Cycle First Occurrence 


Minute (b8) 




Start Time 


B 


Cycle First Occurrence 


Second (bS) 




Start Time 


C 


Upload (Total b24) 


Hours{0-24) (b8) Defines a 




Duration 


duration of time over which the 






STB randomizes upload start 






time. 


D 


Upload Duration 


Mimites(0-59) [b8) 


E 


Upload Duration 


Seconds(0-59) (b8) 


F 


Cycle Time (Total b32) 


Days (0-14) (t>8) Defines the 






periodicity (mean time) between 






uploads. 


10 


Cycle Time 


Hours(0-24) (b8) 


11 


Cycle Time 


Mimites(0-59) (b8) 


12 


Cycle Time 


Seconds(0-59) (b8) 



Cycle_First_Occuianct_Start_Time 



Cycle Tune 
Upload Duration 



12:00 am Jan 1, 1995 + "X" * 
15 minutes. "X' f staggers each 
upload group by 15 minutes; 30 
X = number of Groups 
24 hours 
15 minutes 



A total of four upload cycles will be defined for each group 35 
of STBs 30, which allows for weekly uploads or any other 
combination of cycles to work around peak network 52 load 
times. 

STBs 30 can be instructed as to their role in uploading by 
sending from staging server 70 appropriate commands that 40 
are handled by the clicks tream upload controller 38. For 
instance, the following commands may be addressed and 
sent by staging server 70 to a single or group of STBs 30. 



TABLE XII 



Ciickstream Upload Control Commands 
Octet* Contents 



T 0 Transaction Code MSB - 0 x 80 
T 1 Transaction Code LSB « 0 x 10 

0 Clickstrcam Processor Version Number 

1 Global Addressable Group Address Denotes the group of 
Rag Flag STBs to field this 1 
(bl) (bl) transaction (b5) 

2 Collection On/OfI Key Will turn clickstrcam collection 

On/OS to a STB or Group of STBs 
(non-Global only). 

3 Perform Upload Now Key Will perform an upload on 

command. Will only upload on 
command if Global Flag is NOT 
set. 

4 Suppress Upload on Will keep the STB or Group from 
Buffer Ful -uploading when buffer is full. 

The STB or Group will only 
upload on it's appointed upload 
cycle. 

5 Up]oad_Cyc]e_Definitian A STB will have 1 to 4 possible 

upload cycles defined. This will 
define any one of those cycles. 



Depending on how the system is configured, the commands 
instruct STBs 30 to: 1) define the cyclic upload for various 
groups of or even all STBs 30; 2) require STBs 30 to upload 
on command/polling control (addressable only); 3) suppress 
upload when a buffer 42 or 44 fills; or 4) turn on/off event 
record collection by particular or groups of STBs 30. 

Event Record Formatting, Upload and Capture 

After the upload process triggers, each STB 30 typically 
initiates upload by first locking the buffer 42 or 44 to be 
uploaded and then compressing the contents of that buffer 42 
or 44. Anumber of different compression techniques may be 
used, however, about 50% compression may be achieved 
with LZW compression utilities. Such compression substan- 
tially reduces the load on network 52 caused by numerous 
STBs 30 uploading event records. Compressed data is 
divided into transmission "transactions" or "packets" and 
packet headers are addressed to indicate packet identifica- 
tion, IP destination address, etc. The actual network con- 
nection can be initiated by the operating system for the 
particular STB 30. Persons skilled in the art will recognize 
that the type of and manner of invoking and implementing 
the network connection will vary depending upon the type of 
media delivery network over which system 20 is deployed. 

For instance, the STB 30 can be configured to insert 
UDP/IP headers and trailers taken from the RFC 791 or RFC 
768 specifications published by the ISO. Each data packet 
may have UDP/IP protocol built around a Level 1 pass- 
through header, such as shown in Table XIII below: 

TABLE XIII 

UDP/IP Protocol for Headers 



Header 
Length 



Type of 
Service 



Total Length 



1 

2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 
26 
27 
28 




COUNT FOUR: INFRINGEMENT OF U.S. PATENT NO. 6,983,478 

27. AT&T incorporates by reference Paragraphs 1 through 26, as if fully set forth 

herein, 

28. United States Patent No. 6,983,478, entitled "Method and System for Tracking 
Network Use" (hereinafter, the '"478 patent"), duly and legally issued on January 3, 2006 after a 
full and fair examination. AT&T Intellectual Property I, L.P. is the assignee of all rights, title, 
and interest in the '478 patent, including the right to sue and recover for all past infringement, A 
true and correct copy of the '478 patent is attached as Exhibit D. 

29. As an example, and not to be limited to only a single infringing product, TiVo has 
developed, has tested, promotes, markets, uses and sells services for tracking DVR-use patterns, 
such as "Stop | [Watch" and "Power | [Watch." Such services (or the systems used to provide such 
services) fall within the scope of one or more claims of the '478 patent. 

30. TiVo has infringed and continues to infringe the '478 patent, by, among other 
acts, making, using, offering for sale, and/or selling within this Judicial District and elsewhere in 
the United States, without license or authority by AT&T, services covered by one or more claims 
of the '478 patent, including, but not limited to, services for tracking DVR-use patterns. 

31. As a consequence of TiVo' s infringement, AT&T is entitled to recover damages 
adequate to compensate it for the infringement complained of herein, but in no event less than a 
reasonable royalty. 

32. TiVo has caused and will continue to cause AT&T substantial damage and 
irreparable injury by virtue of its past and continuing infringement of the *478 patent. TiVo will 
continue to infringe the '478 patent unless enjoined by this Court. AT&T will suffer further 
damage and irreparable injury unless and until TiVo is enjoined by this Court from continuing 
such infringement. 

JURY DEMAND 

AT&T hereby demands a jury trial on all issues so triable. 



COMPLAINT -6- 
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TJDP/IP Protocol For Headers 



Identification Flags Fragment Offset 

Time to live Protocol Header Checksum 

Source IP Address 
Destination IF Address 
UDP Header 



Source Port 
Length 



Destination Port 
Checksum 



In the embodiment shown in the Figures, the clickstream 
processor 34 will identify a particular VSP — Video Service ^ 
Provider, which is an entity connecting to network 52 to 
distribute services — like VSP 66 shown in FIG. 4B, as the 
destination of these data packets. All of the data to be 
uploaded appears as "pay load" to the STB 30, the signaling 
network 52, the network management controller 50, and the 20 
event capture process 71 on the staging server 70. After an 
appropriate header and trailer inserted at the STB 30, the 
upload data packet may have the format shown in Table 
XIV: 



TABLE XIV 



ClLckstream Upload Data Packet 



Octet# Contents 



30 



T 0 Transaction Code MSB - 0x80 

T 1 Transaction Code LSB = 0x38 

0 Clickstream Processor Version Number 

1 Upload Sequence Number 

0x02 Clickstream Upload Buffer Data Structure (as shown in Table I 

thr. and X). The data may be broken up into as many reverse path 35 

OxFA transactions as necessary to complete data upload. 



Providing two buffers 42, 44 allows event record collec- 
tion to continue during upload. Assuming buffer 42 is being 
uploaded, if the second buffer 44 fills during the upload 40 
process, a buffer overrun condition occurs. To account for 
such an occurrence, the buffer trailer record sent during 
upload from STBs 30 may denote such an error condition. 
The structure of the buffer trailer record may take the form 
as shown in Table XV below and include a time stamp, 45 
assigned application identification, length and upload code. 



TABLE XV 



Buffer Trailer Record 






Size 


Timestamp 


6 bytes 


Assigned Application ID 


16 bits 


Number Bytes to Follow (length) 


8 bits 


Upload Status Code 


8 bits 



These upload status codes identify the stage of the upload 
process at the time a buffer 42 or 44 overflow occurred. 
Thus, some possible upload codes could include: upload not 60 
used, upload in progress, upload completed but no acknowl- 
edgment received, upload completed but only partial 
acknowledgment received or no upload attempted. This will 
let the staging server 70 know that STB 30 event records are 
missing beginning at that time. Also, receiving a buffer 65 
overrun record informs the staging server 70 that buffer 42 
or 44 sizes have not been set appropriately. Buffer 42 or 44 



sizes can then be reset and released to the system 20 as an 
update or released to a particular STB 30 by sending it an 
appropriate command. 

Note that the packetization description above is for one 
embodiment of the system 20. However, generally, to upload 
collected event records, STBs 30 can initiate whatever 
"upstream" data transmission process used by the interac- 
tive, cable television or other media delivery system with 
which the system 20 is used. That process will upload the 
event records in the appropriate system format. 

In any event, for system 20, clickstream data packets are 
uploaded to the staging server 70 over a slotted- ALOHA (a 
contention-based standard transport protocol) data transmit- 
ter of the STB 30. Data acknowledgments from the staging 
server 70 are sent; each is addressed to particular STBs 30. 
The frequency and period of data acknowledgments may be 
determined by considering network error rates, network 
packet error rates and causes of those types transmission 
errors. 

FIGS. 4A and 4B show in greater detail the clickstream 
data flow through the system 20. Briefly, FIG, 4A shows that 
clickstream packets of event records are transmitted from 
each STB 30 to the network management controller 50, 
which acts as a video service provider router. From the 
network management controller 50, which manages traffic 
over network 52, packets are forwarded via the network 52, 
video server 60 and video server control 56 to the staging 
server 70, which couples to MKIS 100 and analysis engine 
110. Thus, event records collected and buffered at STBs 30 
are transmitted to the staging server 70 for collection and 
analysis. 

FIG. 4B shows this process in more detail and also 
describes an event records capture process 71 at staging 
server 70. 

As noted, once a buffer 42 or 44 fills or the clickstream 
processor 34 decides to upload data for other reasons (time 
expiration, low system utilization, commanded upload, etc.), 
the buffer 42 or 44 will be formatted, compressed and then 
uploaded through the system 20 to the staging server 70. The 
upstream data packets may travel from the network man- 
agement controller 50 across the distribution network 52 to 
video server 60 through a process called IP ("Internet 
Protocol") tunneling, which is essentially automatic IP rout- 
ing based upon information in the packet payload. The same 
process can be used to route packets through network 52 
directly to staging server 70 without going through video 
server 60. FIG. 4B shows that, at video server 60, an LI 
pass-through process 63 uses a VSP routing table 67 to 
associate destination IP addresses with corresponding tags 
inserted in the received data packets. This process re-directs 
the data packets to the application server 66 LI pass-through 
process 63 by associating the tags with the appropriate listed 
destination — here, the application server 66. The LI pass- 
through process 63 on application server 66 performs a 
similar function with the data packets, routing them based on 
a payload identifier (transaction code or other) to an event 
record capture ("ECAP") open server process 71 on the 
staging server 70. 

When the ECAP process 71 receives a clickstream data 
packet, it accepts the data packet and correlates the source 
address of the data packet with an upload session already in 
progress with a particular STB 30. If there is currently no 
upload in progress with that STB 30, then one is considered 
to be initiated. ECAP process 71 processes the upload of 
data in accordance with the particular protocol needed for 
the system 20. After receipt of all clickstream data packets 
associated with the upload from a particular STB 30, the 
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ECAP process 71 sequences the packets into proper order even a traditional cable or wireless cable network requires 
(particular packets may have arrived out of tbeir original priority assignments. Typically, local cable operators typi- 
transmission sequence because of transmission delays in cally are allowed to insert local ads over certain national ads 
network 52), decompresses the packets, eliminates transport (assuming they can sell that local ad time), 
overhead (e.g., trailers, headers, etc.) and stores them, such s FIG. 6B depicts such priority assignments. FIG. 6B shows 
as in a flat file, for later analysis. At the end of a selected several sources of data, such as EPG metadata, National and 
period, like 24 hours, the file is closed and a new one is Local Insert ad metadata and Interactive Sessions metadata, 
opened, which allows a subsequent merge and parse process EPG metadata is usually very broad — for instance, showing 
to batch process discrete files that cover discrete time a football game on channel 1 from 1:00 to 4:00 p.m. Thus, 
periods, Immediately after initiation of and during the ECAP 10 EPG metadata is assigned a priority lower than that of 
process 71, an operation log is opened to record information national ad metadata because a particular national ad will be 
about the initiation and termination of each upload session overlayed into a particular time slot broadly defined by the 
and any errors. EPG. In turn, local insert ad metadata trumps national ad 
As shown in FIG. 5, staging server 70 will formulate and metadata because the national ad metadata may not account 
send a data acknowledgment to each STB 30 engaged in the 15 for situations where a local network or affiliate inserts a local 
upload process. One method of doing so is to send acknowl- ad over the national ad scheduled for a particular timeslot. 
edgments as addressable downstream level one pass-through Finally, interactive sessions metadata, which reflects sub- 
transactions over network 52 to the STB 30. Such data scriber selections, has the highest priority as it shows the 
acknowledgments provide redundant error correction subscriber stopped watching a particular channel and instead 
because failure to receive them may alert STB 30 to a 20 invoked an interactive session. 

possible transmission error. Applying these priority rules produces a timeline 94 for 

each subscriber. Additional filtering criteria 94 are applied 

Merging and Parsing the merge and parse engine 90 in order to generate a 

FIGS. 6A and 6B show an overview of the merging and 25 futtbet , wfined 94 ' aS f^ul ^S' ^ 

parsing process and FIG. 7 shows sample results following exam P le ' event records ^ mcMde such hl 2 hl y S ramjlar 

that process. Briefly, the aim of the merge and parse process and s P ecific information as the number of volume ups or 

is to merge each STB 30's event records with various channel ups that a particular subscriber entered. One set of 

"metadata." "Metadata" refers to (1) programming of vir- filtering criteria 94 may ensure that the timeline 92 inchides 

tually any type shown on system 20 including the time and 30 only channels that were viewed for more than a threshold 

broadcast or cable network providing such programming or (e.g., 15 seconds) time period. This eliminates any very fast 

(2) interactive applications invoked by subscribers. For channel changes made by the subscribers, thereby simpli- 

instance, metadata includes the following sources of data; fying ^ event timelme o 2 because event records that do not 

EPG broadcast programming schedule data 82 broadcast me6t the criteria 94 ^ fillered out of the evem timdine n 

advertising schedule data 84, local advertising schedule data 35 , nA , . t , . . 

or session-services advertising schedule data 86 and session- Mer f and / arse en ^ e »° «J» ^ 'PP* other c " tena 

services programming schedule data 88. (Session-services to filtered timeline 94 ( Qr the on e inal luneline 92 )> as 

advertising refers to advertising inserted by video server 60 shoWn ^ mG - 6 - Specifically, advertisers may wish to apply 

during particular interactive sessions with the subscriber that "view" and "watch" criteria 96. This criteria 96 will identify 

are the session-services programming). 40 those programs and advertisements that are "viewed" by 

Collectively, all of this data enters into a merge and parse subscribers for less than a certain threshold amount of time, 

engine 90 that creates an event timeline 92 for each STB 30. Programming seen by subscribers for more than that tbresh- 

Merge and parse engine 90 may be deployed upon staging D i d) would be identified as "watched" programming. For 

server 70 or the MKIS system 100 J5o deploying merge and e fc fof a 30 second ad ^ ^ be 15 

parse engine 90 on staging server 70 allows collected event 45 j T r u u j * u 1 j- 1 • 

r . fT j j j n- . . seconds. If a subscriber was tuned to a channel displaying 

records to be merged and parsed. The resulting event time- .u . j * 1 u 1- j j.u 

Hues 92 can be sent to MKIS system 100 for further analysis. ad for less than 15 seconds he would be deemed 10 have 

Timeline 92 provides a snapshot of activity on a particular "™wed" that ad, on the other hand, if the subscriber 

STB 30 for a selected period (e.g., 24 hours) or for a selected was mned t0 the channel carrying that ad for 25 seconds of 

event — for instance, a timeline 92 would be created for each 50 the ad ' s length, he would be deemed to have "watched" it. 

STB 30 tuning to a particular show or shows (e.g., a pay per This criteria 96 allows system 20 operators to charge more 

view fight) that may occur over a selected period. Timeline for "watched" ads versus those that are merely "viewed." 

92 is created by merging event records with metadata about Similar criteria can be applied against programming in order 

programming available over the network for the selected t0 more accurately gauge ratings. Thus, for a 30 minute 

time period. 55 program, if a user was tuned to that program for less than 10 

To merge that data, proper priority must be assigned to minuteS) the ^ md watch 96 decide that the 

data that otherwise may be conflicting. For instance, broad- , u . , „ T t , . 

j . . , 1 a J . ... , . . program was only viewed. Id any event, applying the view 

cast advertising data 84 may indicate that a certain national : ■ % n 

ad was run at Time A. On the other hand, if the system 20 and Watch cntena 96 ' mer ^ and P arse en S ,ne 90 CreateS 

is an interactive system and the interactive server provided 60 Uview " and " watcb " lists 9S tnat m useful for the s y stem 20 

a targeted advertisement ("ad") also at Time A, as indicated operator and advertisers who contract with system 20 opera- 

by session -services advertising data 86, that targeted ad was lor. 

inserted over the national ad at Time A. Thus, by assigning Note also that other criteria than simply how much time 

session-services advertising data 86 a priority higher than a tuned to a particular channel may be included in the view 

national broadcast advertising data 84, the merge and parse 65 and watch criteria 96. For instance another criteria may be 

engine 90 is able to create an accurate timeline 92 of volume level. If a viewer was tuned to a channel for the full 

programming delivered to a particular STB 30. Similarly, thirty second length of an ad but hit the mute button or 
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changed the volume below a certain threshold for that ad, 
view and watch criteria 96 may classify that ad as a 
"viewed" ad. 

Generally, merging and parsing should be done on dis- 
crete segments of data, such as 24 hour segments, as soon as 5 
possible in order to minimize the occurrence of un -resolved 
events. In other words, discrete events are simply pieces of 
the entire picture. To analyze only several hours of click- 
stream event data would not allow determination of such 
things as programming "watched" versus "viewed," to 

FIG. 7 shows a sample merge of event records or click- 
stream data SO, EPG data 82 from Prevue or a similar service 
and broadcast advertising data 84 that creates a clickstream 
timeline 92, which shows both the channels selected by a 
subscriber and the content displayed on those channels while 15 
the subscriber watched them. 

A timeline 94 for each STB 30 is built and uploaded by 
staging server 70 to the MKIS database 100 or a third party 
analysis engine and database 110, either of which may store 
demographics and be used to run queries against the event 20 
timelines 94 and those demographics. Combining the time- 
lines 94 with demographics information allows for even 
more detailed and granular information about subscribers 
and their viewing habits. For instance, consider the follow- 
ing examples: 

EXAMPLE 1 

Widget Co. has ten different advertisements that it has 
been running on system 20. Widget Co. wishes to know 
whether subscribers are "viewing" or "watching" particular 
ads. Because of the detailed information captured by the 
system 20 of the present invention, a query can be formu- 
lated to determine (a) which subscribers "watched" particu- 
lar 30 second advertisements for greater than 15 seconds 
versus (b) which subscribers simply "viewed" the ad, for 
less than 15 seconds. 



EXAMPLE 2 

When event timelines 94 (or view and watch lists 98) are 
loaded into MKIS 100 or analysis engine 110, the same 
query can be run for a particular demographic group. For 
instance, Widget Co. wishes to know which particular ads its 45 set top boxes, 
primary customer base, baby boomers between ages 40 and 
50 and with income over $50,000 per year, "watched" versus 
"viewed" their advertisements. 

Obviously, the system 20 can also be modified to target 



What is claimed is: 

1. A system for collecting and processing information 
about subscribers* selection and use of programming dis- 
tributed over a media delivery network, the system com- 
prising: 

a) merge processor coupled via means for communication 
to 

b) a plurality of set top boxes, each comprising a proces- 
sor for 

(1) collecting a plurality of event records that describe 
selected commands from a subscriber to a particular 
set top box and 

(2) transmitting event records to the merge processor; 

c) wherein the merge processor forms aD event timeline 
describing a subscriber's selection of distributed pro- 
gramming for a discrete time period by merging the 
event records with programming data describing pro- 
gramming available via the media delivery system. 

2. A system according to claim 1 wherein the program- 
ming data comprises data collected from at least two sources 
selected from the group consisting of: a broadcasting sched- 
ule source, a national advertising schedule source, a local 

25 advertising schedule source and an interactive application 
use schedule source, 

3. A system according to claim 1 wherein each set top box 
further comprises a plurality of applications capable of being 
invoked by a subscriber. 

30 4. A system according to claim 3 wherein each event 
record comprises: 

(1) an application identifier corresponding to the applica- 
tion associated with the recorded event; 
35 (2) an event identification code; and 

(3) a time stamp associated with the initiation of the event. 
5. A system according to claim 4 wherein each application 
creates an event upon detection of selected commands from 
the subscriber. 

40 6. A system according to claim 1 further comprising a 
buffer for storing the event records before transmission. 

7. A system according to claim 1 wherein the merge 
processor forms an event timeline for each of the plurality of 



8. A system according to claim 7 further comprising an 
analysis engine for correlating the event timelines with 
demographics information describing the subscribers. 

9. A method for joumaling information about subscriber 
ads to particular demographic households based on feedback 50 use of a media delivery network for delivering programming 



from parsed and merged data. Then, event records occurring 
after those targeted ads are broadcast over system 20 can be 
checked to determine whether the particular demographic 
market targeted watched or viewed the advertisement. 

The foregoing is provided to explain and disclose pre- 55 
ferred embodiments of the present invention, modifications 
to which may be made that still fall within the following 
claims. For instance, the architecture and programming of 
the system may be modified. Or, a variety of different 
manufacturers' servers, set top boxes or databases may be 60 
configured in order to implement the system. The particular 
identification codes and allocated sizes show in the tables 
and described herein may also be greatly modified. Further 
modifications and adaptations to the described embodiments 
will be apparent to those skilled in the art and may be made 65 
without departing from the scope or spirit of the invention 
and the following claims. 



and a merge processor for analyzing the resulting joumaled 
information, the method comprising the steps of: 

a) collecting information about a plurality of subscribers' 
use of a media delivery network, the collecting step 
comprising: 

i) identifying commands of interest from each sub- 
scriber; 

ii) forming event records that record at least the com- 
mands of interest and a time associated with the 
command; 

b) transmitting event records to the merge processor; 

c) merging the event records with data describing the 
programming delivered over the media network in 
order to form event timelines of which describes the 
programming selected by a particular subscriber over a 
discrete time period. 
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10. A method according to claim 9 wherein the identifying 
step comprises the step of correlating each command of 
interest with a global table comprising identification codes. 

11. A method according to claim 9 further comprising the 
step of filtering the event timelines in order to classify 5 
subscribers' viewing patterns into at least two categories. 

12. A method according to claim 11 wherein the first 
category comprises programming watched by a subscriber 
for greater than a selected threshold percent of the total 
program length. io 

13. A system for determining the viewing habits of 
subscribers to a media delivery network for delivering 
programming, the system comprising: 

a) a collector for collecting event records describing 
subscribers' selection and use of programming; 15 

b) means, coupled to the collector, for communicating 
event records to 

c) a merge processor for processing the event records to 
form a selected subscriber an event timeline describing 
the programming delivered to a selected subscriber 2a 
over a particular time period via the media delivery 
network; 

d) means for storing demographics information about 
selected groups of subscribers; and 
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e) wherein the merge processor forms a plurality of event 
timelines and correlates the demographics information 
with the event timelines. 

14. A system according to claim 13 in which the merge 
processor applies filtering criteria to the event records to 
determine the programming watched by a subscriber for 
greater than a selected percent of the programming. 

15. A system according to claim 14 in which the collector 
is deployed upon a set top box that is associated with a 
display device for displaying delivered programming. 

16. A system according to claim 15 in which the sub- 
scriber controls the set top box via a remote device in order 
to invoke and run a variety of applications and the collector 
forms event records by: 

a) identifying a code that corresponds to a command of 
interest entered by a selected subscriber; and 

b) storing in a buffer, associated with the collector, an 
event record comprising 

(1) the code corresponding to the command; and 

(2) a time stamp. 

***** 
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PRAYER 



WHEREFORE, AT&T prays for relief against TiVo as follows: 

a. A judgment that TiVo has infringed the claims of U.S. Patent Nos. 5,809,492; 
5,922,045; 6,118,976; and 6,983,478 (collectively, "the patents-in-suit"); 

b. A permanent injunction enjoining TiVo, its officers, agents, servants, employees, 
representatives, licensees, successors, assigns, and those persons in active concert or 
participation with any of them, from making, using, selling, offering to sell, and importing 
products, services, or processes that infringe the patents-in-suit; 

c. Awarding AT&T damages adequate to compensate for the infringement by TiVo, 
but in no event less than a reasonable royalty for the use made of the invention by TiVo, together 
with interest and costs under 35 U.S.C. § 284; 

d. Awarding pre-judgment and post-judgment interest on the damages assessed; and 

e. Awarding to AT&T such other and further relief as the Court deems just. 

Dated: March 1 2, 20 1 0 Respectfully submitted^ 



BAKER BOTJgT.L.P. 




Bryant C. Boren Jr. 
Attorneys for Plaintiffs 
AT&T Intellectual Property I, L.P. and 
AT&T Intellectual Property II, L.P. 
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